Utility Usage

Utility Usage#

This document provides information about utility tools that can be used to check the status of the Mobilint NPU or perform tests.

Linux/Ubuntu#

Mobilint provides two types of utility tools for Linux/Ubuntu environments:

mobilint-cli: Command-line utility for checking NPU status, running benchmarks, and viewing MXQ information.
mobilint-runtime-gui: A GUI-based utility that enables users to easily run and test various AI models on the NPU without writing any code.

mobilint-cli usage#

moblint-cli status : Shows the status information of NPU devices.
- -L or --list-npus : Lists all NPU devices installed on the system.
- -i {device_id} or --id {device_id} : Shows the status of specific NPU device identified by {device_id}. {device_id} corresponds to the number in /dev/aries*.
- -l {second} or --loop {second} : Continuously shows the device status every {second} seconds. If the -i or --id option is omitted, default device is device 0.
- -m {milli_sec} or --loop-ms {milli-sec} : Same as the -l option, but with a millisecond interval.
- -f {file_name} or --file {file_name} : Saves the device status to the file {file_name}.
mobilint-cli mxqtool : Shows information about the MXQ file.
- show {mxq_path} : Shows information about the MXQ file located at {mxq_path}.
- extract {mxq_path} {dir_path} : Extracts the content from the MXQ file at {mxq_file}, including bundled files, and saves them to {dir_path} directory.
- collect {dir_path} {mxq_path} : Reconstructs a new MXQ file at {mxq_path} based on the content of {dir_path}, which was extracted using the extract option.
mobilint-cli testinfer : Tests the inference with the given MXQ file under various settings.
- --repeat-count {num} : Repeats inference {num} times.
- --core-mode {mode} : Specifies the core mode to use during inference. (You must use mode that you specified at compile stage.)
- --mxq-path {mxq_path} : Inference MXQ model located in {mxq_path}.
- --summary : Prints internal information conatained in mxq file specified by --mxq-path option.
- For additional options, please refer to --help option.

Note

mobilint-cli benchmark command currently only support vision models.

moblint-cli benchmark : Performs a benchmark test using the given MXQ file.
- -p {mxq_path} or --mxq-path {mxq_path} : Using MXQ file located at {mxq_path}.
- -t {second} or --time {second} : Performs benchmark test for {second} seconds.
- For additional options, please refer to --help option.

mobilint-runtime-gui usage#

Start GUI server

In the terminal, run following command to start the GUI server.
```
mobilint-runtime-gui
```
If the server starts successfully, an access URL will be displayed in the red box area, as shown below (e.g., “http://127.0.0.1:5000”).
Open in the Web browser

Copy the URL shown in the message, then paste it into your web browser’s address bar to connect.
Use GUI

One the connection is successful, the GUI page will appear as shown below.
Stop the server

To exit, go back to the terminal where the server is running and press “Ctrl + C” to stop the GUI server.