# NPU Operator Support

The following Mobilint IR operation types can be assigned to the target NPUs by qb Compiler. ✅ means support under the common NPU input contract; ⚠️ means support also depends on shapes, attributes, inputs, or neighboring operations; ❌ means unsupported on that device. A listed operation does not guarantee that the full model compiles. Framework operators may be transformed before device allocation.

`regulus-rb-usb` has the same operator scope and conditions as `regulus-rb`.

| Mobilint IR operation | `aries-rb` | `regulus-ra` | `regulus-rb` |
| :--- | :---: | :---: | :---: |
| `Abs` | ⚠️ | ⚠️ | ⚠️ |
| `Adding` | ⚠️ | ⚠️ | ⚠️ |
| `AddingConstant` | ⚠️ | ⚠️ | ⚠️ |
| `Batchnorm` | ⚠️ | ⚠️ | ⚠️ |
| `Celu` | ⚠️ | ⚠️ | ⚠️ |
| `Clip` | ⚠️ | ⚠️ | ⚠️ |
| `Concatenate` | ⚠️ | ⚠️ | ⚠️ |
| `Convolution` | ✅ | ✅ | ✅ |
| `Cos` | ⚠️ | ❌ | ⚠️ |
| `DepthwiseConvolution` | ✅ | ✅ | ✅ |
| `Div` | ⚠️ | ⚠️ | ⚠️ |
| `DivConstant` | ⚠️ | ⚠️ | ⚠️ |
| `Elu` | ⚠️ | ⚠️ | ⚠️ |
| `Erf` | ⚠️ | ⚠️ | ⚠️ |
| `Exp` | ⚠️ | ⚠️ | ⚠️ |
| `Gelu` | ⚠️ | ⚠️ | ⚠️ |
| `GlobalResponseNormalization` | ⚠️ | ⚠️ | ⚠️ |
| `GroupConvolution` | ✅ | ✅ | ✅ |
| `GroupNormalization` | ⚠️ | ⚠️ | ⚠️ |
| `HardSigmoid` | ⚠️ | ⚠️ | ⚠️ |
| `HardSwish` | ⚠️ | ⚠️ | ⚠️ |
| `Hardtanh` | ⚠️ | ⚠️ | ⚠️ |
| `HeaderView` | ⚠️ | ⚠️ | ⚠️ |
| `HeaderViewRevert` | ⚠️ | ⚠️ | ⚠️ |
| `InputConstant` | ✅ | ✅ | ✅ |
| `InstanceNormalization` | ⚠️ | ⚠️ | ⚠️ |
| `InverseSigmoid` | ⚠️ | ⚠️ | ⚠️ |
| `L1Normalization` | ⚠️ | ⚠️ | ⚠️ |
| `L2Normalization` | ⚠️ | ⚠️ | ⚠️ |
| `LayerNormalization` | ⚠️ | ⚠️ | ⚠️ |
| `LeakyRelu` | ⚠️ | ⚠️ | ⚠️ |
| `Log` | ⚠️ | ⚠️ | ⚠️ |
| `MaskedFill` | ⚠️ | ⚠️ | ⚠️ |
| `MatMul` | ⚠️ | ⚠️ | ⚠️ |
| `Mish` | ⚠️ | ⚠️ | ⚠️ |
| `MoeAggregator` | ⚠️ | ⚠️ | ⚠️ |
| `MoeDispatcher` | ⚠️ | ⚠️ | ⚠️ |
| `Multiply` | ⚠️ | ⚠️ | ⚠️ |
| `MultiplyConstant` | ⚠️ | ⚠️ | ⚠️ |
| `OrderedPatchify` | ⚠️ | ⚠️ | ⚠️ |
| `Pad` | ⚠️ | ⚠️ | ⚠️ |
| `Pooling` | ✅ | ✅ | ✅ |
| `Pow` | ⚠️ | ⚠️ | ⚠️ |
| `PRelu` | ⚠️ | ⚠️ | ⚠️ |
| `QuickGelu` | ⚠️ | ⚠️ | ⚠️ |
| `ReduceMax` | ⚠️ | ⚠️ | ⚠️ |
| `ReduceMean` | ⚠️ | ⚠️ | ⚠️ |
| `ReduceMin` | ⚠️ | ⚠️ | ⚠️ |
| `ReduceSum` | ⚠️ | ⚠️ | ⚠️ |
| `RelShift` | ⚠️ | ⚠️ | ⚠️ |
| `Relu` | ⚠️ | ⚠️ | ⚠️ |
| `Reshape` | ⚠️ | ⚠️ | ⚠️ |
| `Resize` | ⚠️ | ⚠️ | ⚠️ |
| `RmsNormalization` | ⚠️ | ⚠️ | ⚠️ |
| `Rsqrt` | ⚠️ | ⚠️ | ⚠️ |
| `Sigmoid` | ⚠️ | ⚠️ | ⚠️ |
| `Sin` | ⚠️ | ❌ | ⚠️ |
| `Slice` | ⚠️ | ⚠️ | ⚠️ |
| `Softmax` | ⚠️ | ❌ | ⚠️ |
| `Softplus` | ⚠️ | ⚠️ | ⚠️ |
| `Sqrt` | ⚠️ | ⚠️ | ⚠️ |
| `StaggeredPadding` | ⚠️ | ⚠️ | ⚠️ |
| `StatefulAttentionMaskWrapper` | ⚠️ | ⚠️ | ⚠️ |
| `StatefulCachedStack` | ⚠️ | ⚠️ | ⚠️ |
| `StatefulGRUWrapper` | ✅ | ✅ | ✅ |
| `StatefulKVCacheWrapper` | ⚠️ | ⚠️ | ⚠️ |
| `StatefulLSTMWrapper` | ✅ | ✅ | ✅ |
| `StatefulRNNWrapper` | ✅ | ✅ | ✅ |
| `StatefulRoPEWrapper` | ⚠️ | ⚠️ | ⚠️ |
| `Sub` | ⚠️ | ⚠️ | ⚠️ |
| `SubConstant` | ⚠️ | ⚠️ | ⚠️ |
| `SubgraphCall` | ⚠️ | ⚠️ | ⚠️ |
| `SumNormalization` | ⚠️ | ⚠️ | ⚠️ |
| `Swish` | ⚠️ | ⚠️ | ⚠️ |
| `Tan` | ⚠️ | ⚠️ | ⚠️ |
| `Tanh` | ⚠️ | ⚠️ | ⚠️ |
| `Transpose` | ⚠️ | ⚠️ | ⚠️ |
| `TransposeConvolution` | ✅ | ✅ | ✅ |
| `Where` | ⚠️ | ⚠️ | ⚠️ |

`Sin` and `Cos` require a supported preceding operation on `aries-rb` and `regulus-rb`.

For inputs and attributes, see [Mobilint IR Operation Formats](<https://docs.mobilint.com/compiler/en/v1.3/ir_formats/index.md>). For CPU execution, see [CPU Offloading](<https://docs.mobilint.com/compiler/en/v1.3/cpu_offloading/index.md>); its scope also depends on the installed qb Runtime.
