frontend.py File Reference#
|
Mobilint SDK qb Compiler v0.11.0.1
MCS002-KR
|
Go to the source code of this file.
Classes | |
| class | qubee.frontend.Model_Dict |
| Wrapper around the Mobilint compiler to support compilation and inference workflows. More... | |
Functions | |
| qubee.frontend.mxq_compile (model, str calib_data_path="", int save_subgraph_type=0, output_subgraph_path="", str model_nickname=None, str save_path=None, backend="onnx", device="cpu", feed_dict=None, dynamic_axes=None, in_dformats=None, quantize_method="maxpercentile", quantize_percentile=0.9999, topk_ratio=0.01, smooth_factor=1.6, min_clip_ratio=-1, act_scale_min=0.0005, is_quant_ch=True, is_asym_quant=False, save_sample=False, inference_scheme="single", yolo_decode_include=False, use_random_calib=False, cpu_offload=False, singlecore_compile=False, optimize_option=0, quant_output="layer", sample_dtype="float", preprocess_dict=None, buffer_mode=1, weight_dtype="float32", use_gpu_only_for_calibration=False, input_shape_dict=dict(), adaq_config=AdaQuantConfig.default_config(), optq_config=OptqConfig.default_config(), mod_config=ModConfig.default_config(), layer_config=LayerConfig.default_config(), llm_config=LlmConfig.default_config(), quantbit_config=QuantBitConfig.default_config(), **kwargs) | |
| Compile a model into a Mobilint eXeCUtable (MXQ) package for execution on Mobilint NPUs. | |
| qubee.frontend.mblt_compile (str|Any model, str mblt_save_path, backend="onnx", device="cpu", feed_dict=None, dynamic_axes=None, in_dformats=None, yolo_decode_include=False, cpu_offload=False, **kwargs) | |
| Export a model to the Mobilint .mblt format without producing an MXQ package. | |
| qubee.frontend.run_mblt_model (str path_to_mblt, bool save_all_outputs=True, Optional[str] inference_output_path=None, Optional[int] target_subgraph=None) | |
Generated by
1.14.0