Runtime Library Installation

Runtime Library Installation#

This section explains how to install the Mobilint NPU qb Runtime which is required to run inference on Mobilint NPUs using precompiled or custom models.

Attention

Please complete driver installation before proceeding with runtime setup.
Before installing the runtime library, please check compatible driver and firmware versions from here.

Linux#

Option 1: Installing via APT on Debian-based OS#

This method installs the runtime system-wide using Debian-based OS’s package manager apt.

Installation Process#

Add the Mobilint APT repository to your system before proceeding with the installation.

Tip

If you’ve already added the Mobilint APT repository during driver installation, you can skip this step.

# Add Mobilint's official GPG key:
sudo apt update
sudo apt install ca-certificates curl
sudo install -m 0755 -d /etc/apt/keyrings
sudo curl -fsSL https://dl.mobilint.com/apt/gpg.pub -o /etc/apt/keyrings/mblt.asc
sudo chmod a+r /etc/apt/keyrings/mblt.asc

# Add the repository to apt sources:
printf "%s\n" \
    "deb [signed-by=/etc/apt/keyrings/mblt.asc] https://dl.mobilint.com/apt \
    stable multiverse" | \
    sudo tee /etc/apt/sources.list.d/mobilint.list > /dev/null

# Update available packages
sudo apt update

Install via apt package manager.
```
sudo apt install mobilint-qb-runtime
```
Verify installation.
```
dpkg -L mobilint-qb-runtime
```

Troubleshooting Anaconda Error#

If you are using anaconda virtual environment, you can get error message like below.

../lib/libstdc++.so.6: version `GLIBCXX_3.4.32' not found

This issue is caused by the version confliction of libstdc++ bundled with Anaconda, and the appropriate solution may vary depending on the Anaconda version. We recommend searching online for the most suitable fix.

Additionally, to prevent such conflicts, it is recommended to use Python’s built-in virtual environment (venv), which utilizes the system’s libstdc++ library.

Option 2: Installing via DNF on RedHat-based OS#

This method installs the runtime system-wide using RedHat-based OS’s package manager dnf. The packages are built against glibc 2.28 (EL8) and support RHEL, Rocky Linux on both x86_64 and aarch64 architectures.

Note

The Mobilint DNF repository currently provides the mobilint-qb-runtime and mobilint-cli packages only. To install the NPU driver on RedHat-based OS, refer to Manual Download.

Installation Process#

Add the Mobilint DNF repository to your system before proceeding with the installation.

# Register the repository
sudo curl -fsSL https://dl.mobilint.com/dnf/mobilint.repo \
     -o /etc/yum.repos.d/mobilint.repo

Install via dnf package manager.

# Install the runtime library
sudo dnf install mobilint-qb-runtime

# (Optional) Install the Mobilint CLI utility
sudo dnf install mobilint-cli

Note

On the first installation, dnf asks for confirmation before importing Mobilint’s GPG signing key. Check that the output below, then please answer y.

Importing GPG key 0x________:
 Userid     : "Mobilint_RPM (gpg key for dnf - RSA key.) <infra@mobilint.com>"
 Fingerprint: 
 From       : https://dl.mobilint.com/dnf/gpg.pub
Is this ok [y/N]: y

Verify installation.
```
rpm -ql mobilint-qb-runtime
```

Option 3: Manual Installation from Download Center#

Requirements#

Download the appropriate runtime library from Mobilint’s official Download Center.

Installation Process#

Unzip the downloaded runtime library file. {RUNTIME_VERSION} corresponding to your runtime library version.

tar -xvzf qb-runtime_aries2-v4_v{RUNTIME_VERSION}.tar.gz

You should see a directory structure like this:

qb-runtime_aries2-v4_v{RUNTIME_VERSION}
├── Makefile
├── qbruntime
│   ├── qbruntime
│   │ ├── include    # include path
│   │ │   └── qbruntime
│   │ ├── lib        # library path
│   │ └── python
│   └── resnet50
└── mobilint-cli

There are two options from here: System-wide installation, or using without installing.

Option 3-1: System-Wide Installation#

Install the runtime library system-wide using the following commands.

cd qb-runtime_aries2-v4_v{RUNTIME_VERSION}
sudo make install

Option 3-2: Use Without Installation#

Specify the paths to qb-runtime_aries2-v4_v{RUNTIME_VERSION}/qbruntime/qbruntime/include and qb-runtime_aries2-v4_v{RUNTIME_VERSION}/qbruntime/qbruntime/lib during compilation as shown below:

g++ -o {output_binary} {source_code} -I{path_to_include} \
    -L{path_to_library} -lqbruntime

Then export environment variable LD_LIBRARY_PATH to let linker know runtime library(*.so) path.

export LD_LIBRARY_PATH={path_to_library}

Option 4: Installation via pip#

Note

Installing the Python library package via pip on Ubuntu is supported starting from runtime library version 0.29.0.

The Python library can be installed using pip. Run the following command to install the Python library package:

pip install mobilint-qb-runtime

Note

The Python wheel uses the manylinux_x_y platform tag, which requires pip 20.3 or later. If pip cannot find the package even on a supported Python version (3.8–3.14), check your pip version and upgrade it if needed:

pip install --upgrade pip

Installing on Windows#

Requirements#

Download the appropriate runtime library from Mobilint’s official Download Center.

Installation Process#

On Windows, only non-installation method is supported. Please refer to section Comiling C++ code - Windows.