Skip to content

NPU Operator Support

The following Mobilint IR operation types can be assigned to the target NPUs by qb Compiler. ✅ means support under the common NPU input contract; ⚠️ means support also depends on shapes, attributes, inputs, or neighboring operations; ❌ means unsupported on that device. A listed operation does not guarantee that the full model compiles. Framework operators may be transformed before device allocation.

regulus-rb-usb has the same operator scope and conditions as regulus-rb.

Mobilint IR operation aries-rb regulus-ra regulus-rb
Abs ⚠️ ⚠️ ⚠️
Adding ⚠️ ⚠️ ⚠️
AddingConstant ⚠️ ⚠️ ⚠️
Batchnorm ⚠️ ⚠️ ⚠️
Celu ⚠️ ⚠️ ⚠️
Clip ⚠️ ⚠️ ⚠️
Concatenate ⚠️ ⚠️ ⚠️
Convolution ✅ ✅ ✅
Cos ⚠️ ❌ ⚠️
DepthwiseConvolution ✅ ✅ ✅
Div ⚠️ ⚠️ ⚠️
DivConstant ⚠️ ⚠️ ⚠️
Elu ⚠️ ⚠️ ⚠️
Erf ⚠️ ⚠️ ⚠️
Exp ⚠️ ⚠️ ⚠️
Gelu ⚠️ ⚠️ ⚠️
GlobalResponseNormalization ⚠️ ⚠️ ⚠️
GroupConvolution ✅ ✅ ✅
GroupNormalization ⚠️ ⚠️ ⚠️
HardSigmoid ⚠️ ⚠️ ⚠️
HardSwish ⚠️ ⚠️ ⚠️
Hardtanh ⚠️ ⚠️ ⚠️
HeaderView ⚠️ ⚠️ ⚠️
HeaderViewRevert ⚠️ ⚠️ ⚠️
InputConstant ✅ ✅ ✅
InstanceNormalization ⚠️ ⚠️ ⚠️
InverseSigmoid ⚠️ ⚠️ ⚠️
L1Normalization ⚠️ ⚠️ ⚠️
L2Normalization ⚠️ ⚠️ ⚠️
LayerNormalization ⚠️ ⚠️ ⚠️
LeakyRelu ⚠️ ⚠️ ⚠️
Log ⚠️ ⚠️ ⚠️
MaskedFill ⚠️ ⚠️ ⚠️
MatMul ⚠️ ⚠️ ⚠️
Mish ⚠️ ⚠️ ⚠️
MoeAggregator ⚠️ ⚠️ ⚠️
MoeDispatcher ⚠️ ⚠️ ⚠️
Multiply ⚠️ ⚠️ ⚠️
MultiplyConstant ⚠️ ⚠️ ⚠️
OrderedPatchify ⚠️ ⚠️ ⚠️
Pad ⚠️ ⚠️ ⚠️
Pooling ✅ ✅ ✅
Pow ⚠️ ⚠️ ⚠️
PRelu ⚠️ ⚠️ ⚠️
QuickGelu ⚠️ ⚠️ ⚠️
ReduceMax ⚠️ ⚠️ ⚠️
ReduceMean ⚠️ ⚠️ ⚠️
ReduceMin ⚠️ ⚠️ ⚠️
ReduceSum ⚠️ ⚠️ ⚠️
RelShift ⚠️ ⚠️ ⚠️
Relu ⚠️ ⚠️ ⚠️
Reshape ⚠️ ⚠️ ⚠️
Resize ⚠️ ⚠️ ⚠️
RmsNormalization ⚠️ ⚠️ ⚠️
Rsqrt ⚠️ ⚠️ ⚠️
Sigmoid ⚠️ ⚠️ ⚠️
Sin ⚠️ ❌ ⚠️
Slice ⚠️ ⚠️ ⚠️
Softmax ⚠️ ❌ ⚠️
Softplus ⚠️ ⚠️ ⚠️
Sqrt ⚠️ ⚠️ ⚠️
StaggeredPadding ⚠️ ⚠️ ⚠️
StatefulAttentionMaskWrapper ⚠️ ⚠️ ⚠️
StatefulCachedStack ⚠️ ⚠️ ⚠️
StatefulGRUWrapper ✅ ✅ ✅
StatefulKVCacheWrapper ⚠️ ⚠️ ⚠️
StatefulLSTMWrapper ✅ ✅ ✅
StatefulRNNWrapper ✅ ✅ ✅
StatefulRoPEWrapper ⚠️ ⚠️ ⚠️
Sub ⚠️ ⚠️ ⚠️
SubConstant ⚠️ ⚠️ ⚠️
SubgraphCall ⚠️ ⚠️ ⚠️
SumNormalization ⚠️ ⚠️ ⚠️
Swish ⚠️ ⚠️ ⚠️
Tan ⚠️ ⚠️ ⚠️
Tanh ⚠️ ⚠️ ⚠️
Transpose ⚠️ ⚠️ ⚠️
TransposeConvolution ✅ ✅ ✅
Where ⚠️ ⚠️ ⚠️

Sin and Cos require a supported preceding operation on aries-rb and regulus-rb.

For inputs and attributes, see Mobilint IR Operation Formats. For CPU execution, see CPU Offloading; its scope also depends on the installed qb Runtime.