qbcompiler.configs.models.EquivalentTransformationConfig Class Reference#
|
Mobilint SDK qb Compiler v1.2
MCS002-EN
|
qbcompiler.configs.models.EquivalentTransformationConfig Class Reference
Configuration for equivalent transformation techniques. More...
Inheritance diagram for qbcompiler.configs.models.EquivalentTransformationConfig:
Classes | |
| class | FeedForwardMultiLut |
| Feed-forward multi-LUT transformation. More... | |
| class | FlattenQuant |
| class | HeadOutChRotation |
| class | InRotation |
| class | NormConv |
| class | OptimizeFfn |
| class | Qk |
| class | QkRotation |
| class | SpinR1 |
| class | SpinR2 |
| class | Ud |
| class | Vo |
Public Member Functions | |
| "EquivalentTransformationConfig" | with_updates (self, **kwargs) |
| Return a copy with updated fields. | |
Static Public Attributes | |
| model_config | |
| int | seed = Field(default=0, description="Random seed for transformation") |
| bool | apply_hadamard_rotation_matrix |
| NormConv | |
| default_factory | |
| alias | |
| Qk | |
| Ud | |
| Vo | |
| FeedForwardMultiLut | |
| SpinR1 | |
| HeadOutChRotation | |
| InRotation | |
| SpinR2 | |
| QkRotation | |
| FlattenQuant | |
| OptimizeFfn | |
Detailed Description
Configuration for equivalent transformation techniques.
Defines parameters for various equivalent transformation methods including NormConv, QK smoothing, and rotation matrices for improved quantization.
- Parameters
-
seed int. Random seed for transformation apply_hadamard_rotation_matrix bool. Apply Hadamard rotation matrix norm_conv NormConv. NormConv equivalent transformation qk Qk. QK smoothing transformation ud Ud. UD transformation vo Vo. VO transformation feed_forward_multi_lut FeedForwardMultiLut. Feed-forward multi-LUT transformation spin_r1 SpinR1. SpinR1 rotation transformation head_out_ch_rotation HeadOutChRotation. Head output channel rotation transformation in_rotation InRotation. Input rotation transformation spin_r2 SpinR2. SpinR2 rotation transformation qk_rotation QkRotation. QK rotation transformation flatten_quant FlattenQuant. Flatten quantization transformation optimize_ffn OptimizeFfn. FFN optimization
Member Function Documentation
◆ with_updates()
| "EquivalentTransformationConfig" qbcompiler.configs.models.EquivalentTransformationConfig.with_updates | ( | self, | |
| ** | kwargs ) |
Member Data Documentation
◆ model_config
|
static |
◆ seed
|
static |
◆ apply_hadamard_rotation_matrix
|
static |
◆ NormConv
|
static |
◆ default_factory
|
static |
◆ alias
|
static |
◆ Qk
|
static |
◆ Ud
|
static |
◆ Vo
|
static |
◆ FeedForwardMultiLut
|
static |
◆ SpinR1
|
static |
◆ HeadOutChRotation
|
static |
◆ InRotation
|
static |
◆ SpinR2
|
static |
◆ QkRotation
|
static |
◆ FlattenQuant
|
static |
◆ OptimizeFfn
|
static |
The documentation for this class was generated from the following file:
Generated by