frontend.py File Reference

frontend.py File Reference#

Mobilint SDK qb Compiler: frontend.py File Reference

Mobilint SDK qb Compiler v0.12.0.0

MCS002-EN

Classes
class	qubee.frontend.Model_Dict
	Wrapper around the Mobilint compiler to support compilation and inference workflows. More...

Functions
	qubee.frontend.mxq_compile (model, str calib_data_path="", int save_subgraph_type=0, output_subgraph_path="", str model_nickname=None, str save_path=None, backend="onnx", device="cpu", feed_dict=None, dynamic_axes=None, in_dformats=None, save_sample=False, inference_scheme="single", yolo_decode_include=False, use_random_calib=False, cpu_offload=False, singlecore_compile=False, optimize_option=0, sample_dtype="float", preprocess_dict=None, buffer_mode=1, start_dram_offset=0, input_shape_dict=dict(), Optional[CompileConfig] compile_config=None, Optional[ResourceManagementConfig] resource_management_config=None, Optional[QuantizationConfig] quantization_config=None, Optional[AdvancedQuantizationConfig] advanced_quantization_config=None, Optional[LlmConfig] llm_config=None, **kwargs)
	Compile a model into a Mobilint eXeCUtable (MXQ) package for execution on Mobilint NPUs.
	qubee.frontend.mblt_compile (str\|Any model, str mblt_save_path, backend="onnx", device="cpu", feed_dict=None, dynamic_axes=None, in_dformats=None, yolo_decode_include=False, cpu_offload=False, **kwargs)
	Export a model to the Mobilint .mblt format without producing an MXQ package.
	qubee.frontend.run_mblt_model (str path_to_mblt, bool save_all_outputs=True, Optional[str] inference_output_path=None, Optional[int] target_subgraph=None)

qubee.frontend.run_mblt_model	(	str	path_to_mblt,
		bool	save_all_outputs = True,
		Optional[str]	inference_output_path = None,
		Optional[int]	target_subgraph = None )

Definition at line 480 of file frontend.py.