SearchWeightScale Configuration

SearchWeightScale Configuration#

Mobilint SDK qb Compiler: SearchWeightScale Configuration
Mobilint SDK qb Compiler v1.0
MCS002-EN
SearchWeightScale Configuration

SearchWeightScale configuration definitions used by Mobilint compiler for model quantization. More...

Classes

class  qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig
 Configuration for searching weight scale. More...

Functions

 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.__init__ (self, bool apply, bool query, bool key, bool value, bool out, bool ffn, bool optional=optional)
 Initialize the SearchWeightScaleConfig.
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.default_config (cls)
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.from_dict (cls, dict config_dict)
 Create SearchWeightScaleConfig from dictionary (JSON structure)
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.to_dict (self)
SearchWeightScaleConfig qbcompiler.configs.search_weight_scale_config.get_search_weight_scale_config (**kwargs)
 Create SearchWeightScaleConfig with partial parameters merged with defaults.

Variables

bool qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.optional = False
dict qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.DEFAULTS
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.apply = apply
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.query = query
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.key = key
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.value = value
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.out = out
 qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.ffn = ffn

Detailed Description

SearchWeightScale configuration definitions used by Mobilint compiler for model quantization.

Function Documentation

◆ __init__()

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.__init__ ( self,
bool apply,
bool query,
bool key,
bool value,
bool out,
bool ffn,
bool optional = optional )

Initialize the SearchWeightScaleConfig.

Parameters
applybool. Whether to apply weight scale search.
querybool. Apply to query layer.
keybool. Apply to key layer.
valuebool. Apply to value layer.
outbool. Apply to output layer.
ffnbool. Apply to FFN layer.
optionalbool. Indicates whether this config is optional. Use the default value defined as a class variable.

Definition at line 26 of file search_weight_scale_config.py.

◆ default_config()

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.default_config ( cls)

Definition at line 55 of file search_weight_scale_config.py.

◆ from_dict()

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.from_dict ( cls,
dict config_dict )

Create SearchWeightScaleConfig from dictionary (JSON structure)

Definition at line 59 of file search_weight_scale_config.py.

◆ to_dict()

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.to_dict ( self)

Definition at line 81 of file search_weight_scale_config.py.

◆ get_search_weight_scale_config()

SearchWeightScaleConfig qbcompiler.configs.search_weight_scale_config.get_search_weight_scale_config ( ** kwargs)

Create SearchWeightScaleConfig with partial parameters merged with defaults.

Definition at line 94 of file search_weight_scale_config.py.

Variable Documentation

◆ optional

bool qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.optional = False
static

Definition at line 16 of file search_weight_scale_config.py.

◆ DEFAULTS

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.DEFAULTS
static
Initial value:
= {
"apply": False,
"query": False,
"key": False,
"value": False,
"out": False,
"ffn": False,
}

Definition at line 17 of file search_weight_scale_config.py.

◆ apply

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.apply = apply

Definition at line 47 of file search_weight_scale_config.py.

◆ query

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.query = query

Definition at line 48 of file search_weight_scale_config.py.

◆ key

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.key = key

Definition at line 49 of file search_weight_scale_config.py.

◆ value

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.value = value

Definition at line 50 of file search_weight_scale_config.py.

◆ out

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.out = out

Definition at line 51 of file search_weight_scale_config.py.

◆ ffn

qbcompiler.configs.search_weight_scale_config.SearchWeightScaleConfig.ffn = ffn

Definition at line 52 of file search_weight_scale_config.py.