make_calib_data.py File Reference

make_calib_data.py File Reference#

Mobilint SDK qb Compiler: make_calib_data.py File Reference

Mobilint SDK qb Compiler v1.2

MCS002-EN

Functions
	qbcompiler.calibration.make_calib_data.get_yaml (str yaml_path)
	qbcompiler.calibration.make_calib_data.make_calib_man (pre_ftn, str data_dir, str save_dir, str save_name, str anno_json=None, str file_format="%012d.jpg", int max_size=-1, bool remove_npy=False, int seed=2023, bool save_calib_msg=False, str msg_path=None)
	From images and a user-provided preprocessing function, generate calibration NumPy files and a manifest.
str	qbcompiler.calibration.make_calib_data.make_calib (Union[str, dict] args_pre, str data_dir, str save_dir, str save_name=None, str anno_json=None, str file_format="%012d.jpg", int max_size=-1, bool remove_npy=False, int seed=2023, bool save_calib_msg=False, str msg_path=None)
	Create calibration NumPy files and a manifest using a YAML or dict preprocessing configuration.
List[str]	qbcompiler.calibration.make_calib_data.make_calib_llm (Union[str, dict] args_pre, str dataset_name, Union[List[str], str] subset_list, str text_field, str split, str save_dir, int max_calib=512, Optional[str] save_prefix=None)
	Generate calibration embeddings for LLM models using Hugging Face datasets.