qbcompiler.frontend.Model_Dict Class Reference

qbcompiler.frontend.Model_Dict Class Reference#

Mobilint SDK qb Compiler: qbcompiler.frontend.Model_Dict Class Reference

Mobilint SDK qb Compiler v1.0

MCS002-EN

Wrapper around the Mobilint compiler to support compilation and inference workflows. More...

Inheritance diagram for qbcompiler.frontend.Model_Dict:

Public Member Functions
	__init__ (self, model, backend="onnx", device="cpu", feed_dict=None, dynamic_axes=None, in_dformats=None, yolo_decode_include=False, use_custom_mask=False, exclude_first_subgraph=False, **kwargs)
	Initialize the Mobilint compiler wrapper.
	compile (self, str calib_data_path=None, str save_path=None, int save_subgraph_type=0, output_subgraph_path="", str model_nickname=None, save_sample=False, use_random_calib=False, inference_scheme="single", cpu_offload=False, optimize_option=1, str sample_dtype="float", buffer_mode=1, compile_config=None, **kwargs)
	Compile the wrapped model into an MXQ artifact.

Wrapper around the Mobilint compiler to support compilation and inference workflows.

Capabilities include:

Definition at line 23 of file frontend.py.

qbcompiler.frontend.Model_Dict.__init__	(		self,
			model,
			backend = "onnx",
			device = "cpu",
			feed_dict = None,
			dynamic_axes = None,
			in_dformats = None,
			yolo_decode_include = False,
			use_custom_mask = False,
			exclude_first_subgraph = False,
		**	kwargs )

Initialize the Mobilint compiler wrapper.

Parameters

model	string or model instance. Model path or in-memory model to compile.
backend	string. Framework identifier for the model (for example "onnx"). Defaults to "onnx".
device	string. Target device for inference ("cpu" or "gpu"). Defaults to "cpu".
feed_dict	dict. Example inputs for shape resolution.
dynamic_axes	dict. Marks model axes as dynamic.
in_dformats	dict. Describes input data formats.
yolo_decode_include	bool. Runs YOLO decode on NPU when `True`.
use_custom_mask	bool. For non-LLM models that include a mask, use a custom mask provided as a separate input instead of the causal mask.
exclude_first_subgraph	bool. Applies only when CPU offloading is enabled: exclude the first subgraph from the final graph if it is unsupported.
kwargs	dict. Additional compiler arguments.

Definition at line 33 of file frontend.py.

qbcompiler.frontend.Model_Dict.compile	(		self,
		str	calib_data_path = None,
		str	save_path = None,
		int	save_subgraph_type = 0,
			output_subgraph_path = "",
		str	model_nickname = None,
			save_sample = False,
			use_random_calib = False,
			inference_scheme = "single",
			cpu_offload = False,
			optimize_option = 1,
		str	sample_dtype = "float",
			buffer_mode = 1,
			compile_config = None,
		**	kwargs )

Compile the wrapped model into an MXQ artifact.

Parameters

calib_data_path	string. Calibration dataset directory or meta file (.txt/.json) listing NumPy samples.
save_path	string. Output MXQ filename.
save_subgraph_type	int. Controls optional MBLT exports: 0 disables; 1 saves graph structure; 2 saves structure and weights; 3 splits structure into multiple subgraphs; 4 splits structure and weights.
output_subgraph_path	string. Destination for exported .mblt when `save_subgraph_type` is 1–4.
model_nickname	string. Friendly name stored in qbcompiler for faster recompile.
save_sample	bool. Persists inputs/outputs for debugging in ./sampleInOut.
use_random_calib	bool. Uses randomly generated calibration samples when `True`.
inference_scheme	string. NPU inference configuration ("single", "multi", "global", etc.).
cpu_offload	bool. Enables CPU offload for unsupported groups.
optimize_option	int. Compiler optimization selector.
sample_dtype	string. Data type used for saved sample outputs.
buffer_mode	int. Buffer serialization mode (0 naive, 1 mmap).
compile_config	CompileConfig. Compile configuration object.
kwargs	dict. Additional arguments forwarded to the compiler.

Definition at line 73 of file frontend.py.

The documentation for this class was generated from the following file: