Build AI inference on Mobilint NPUs#
qb Runtime gives developers, engineers, and researchers the building blocks to run AI inference on Mobilint NPUs
Tip
qb Runtime v1.3.1 released — 16-bit integer support, plus stability and performance improvements. See the release notes.
Important
Driver installation, firmware update, and NPU core configuration guides for ARIES devices have moved to the ARIES manual. This manual covers the qb Runtime and its utilities.
What is qb Runtime?#
qb Runtime is the inference engine of SDK qb, Mobilint’s software development kit for its Neural Processing Unit (NPU). It loads models compiled into Mobilint’s executable format (MXQ) by the qb Compiler and runs them on the NPU using internal optimized logic.
C++ and Python interfaces: Integrate NPU inference into your application with the runtime library’s C++ and Python APIs.
Linux and Windows support: Deploy on either operating system for easier system integration.
Mobilint Model Zoo#
Mobilint provides a growing Model Zoo of open-source models precompiled for Mobilint NPUs. These .mxq (Mobilint eXeCUtable) files are optimized for Mobilint’s runtime and can be deployed immediately on supported NPU hardware. New models are added regularly to support evolving AI workloads and customer requests.
490+ pre-compiled models: Computer vision, natural language processing, and multimodal AI models ready to run as
.mxq.
Get Started#
Go from installing the product to maximizing its performance with advanced functions.
Tip
Have questions or need custom deployment support? Contact us at https://discuss.mobilint.com.