```{toctree}
:hidden:
:maxdepth: 2
:caption: Overview
Getting Started <getting_started>
Release Notes <release_note>
```

```{toctree}
:hidden:
:maxdepth: 2
:caption: Installation
Installing Driver <installing_driver>
Installing Runtime Library <installing_runtime_library>
compatibility
Firmware Update <update_firmware>
Installing Compiler <installing_compiler>
```

```{toctree}
:hidden:
:maxdepth: 2
:caption: Tutorials
(Basic) Running Pre-Compiled ResNet50 <tutorial_resnet50>
Programming Guide <programming_guide>
```

```{toctree}
:hidden:
:maxdepth: 2
:caption: Utilities
Installing Utility <installing_utility>
utility_usage
Mobilint Model Zoo <model_zoo>
```

```{toctree}
:hidden:
:maxdepth: 2
:caption: Deep Dive
advanced_usage
multicore
```

```{toctree}
:hidden:
:maxdepth: 2
:caption: Deployment
Mobilint Device Plugin <kubernetes_device_plugin>
```

```{toctree}
:hidden:
:maxdepth: 2
:caption: Supported Hardware
ARIES MLA100 PCIe Card <aries-mla100-pcie-card>
ARIES MLA100 MXM Module <aries-mla100-mobile-express-module-mxm>
ARIES MLX-A1 Edge AI PC <aries-mlx-a1-edge-ai-pc>
```

```{toctree}
:hidden:
:maxdepth: 2
:caption: Reference
C++ API <../doxygen/html_en/group__CPPAPI>
Python API <../doxygen/html_en/group__PythonAPI>
Classes <../doxygen/html_en/annotated_classes>
Files <../doxygen/html_en/files>
Deprecated List <../doxygen/html_en/deprecated>
Changelog <CHANGELOG>
```

```{toctree}
:hidden:
:maxdepth: 2
:caption: mbltml
C API <../doxygen/html_en_mbltml/group__MbltmlCAPI>
Python API <../doxygen/html_en_mbltml/group__MbltmlPyAPI>
Classes <../doxygen/html_en_mbltml/annotated>
Files <../doxygen/html_en_mbltml/files>
```

# Build AI inference on Mobilint NPUs

SDK qb gives developers, engineers, and researchers the building blocks to set up Mobilint's NPU and run AI inference on supported hardware — from a desktop prototype to an embedded AI system.

- [Get Started](getting_started.md)
- [API Reference](../doxygen/html_en/group__CPPAPI)

```{tip}
**qb Runtime v1.3.1** released — 16-bit integer support, plus stability and performance improvements. See the [release notes](release_note.md).
```

## What is SDK qb?

**SDK qb** is Mobilint's software development kit designed to enable efficient and optimized utilization of Mobilint's Neural Processing Unit (NPU). It is composed of three proprietary modules that bring out the full performance of Mobilint's NPU products and enable seamless integration in deployment processes.

- **Driver**: The bridge between software and hardware.
- **qb Runtime**: Convenient and fast inference using internal optimized logic.
- **qb Compiler**: Translates deep learning models into Mobilint's executable format, MXQ.

These modules are available in flexible combinations depending on the form factor and core NPU involved.

## Technical Overview

The following diagrams show how SDK qb's components work within the target application and device.

![Model Build](/res/image/SDK_Model_Build.png)

![Runtime Execution](/res/image/SDK_Runtime_Execution.png)

SDK qb supports both **Linux (Ubuntu) and Windows OS** for easier system integration. It is compatible with major deep learning frameworks such as **TensorFlow, TFLite, ONNX, KERAS, and PyTorch**. The runtime library provides interfaces in both **C++ and Python**.

## Mobilint Model Zoo

Mobilint provides a growing **Model Zoo** of open-source models precompiled with Mobilint's `qb compiler`. These **`.mxq`** (Mobilint eXeCUtable) files are optimized for Mobilint's runtime and can be deployed immediately on supported NPU hardware. New models are added regularly to support evolving AI workloads and customer requests.

- [400+ pre-compiled models](model_zoo.md): Computer vision, natural language processing, and multimodal AI models ready to run as `.mxq`.

## Get Started

Go from installing the product to maximizing its performance with advanced functions.

- [Installation and first inference](getting_started.md)


```{tip}
Have questions or need custom deployment support?
Contact us at [https://discuss.mobilint.com](https://discuss.mobilint.com).
```