Sample data generation and saving configuration.
More...
|
| "SaveSampleConfig" | with_updates (self, **kwargs) |
| | Return a copy with updated fields.
|
Sample data generation and saving configuration.
- Parameters
-
| apply | bool. Enable sample data saving |
| mode | str. Inference mode: infer (standard) or inferWithCache (LLM cache models) |
| batch_size | int. Number of inference batches to generate |
| batch_seq_lens | List. Per-batch step-wise sequence lengths for inferWithCache mode. e.g. [[80, 1], [240, 10]] |
| save_folder | str. Output folder for sample data |
| dtype | str. Data type for saved samples: float or int8 |
Definition at line 1389 of file models.py.
◆ with_updates()
| "SaveSampleConfig" qbcompiler.configs.models.SaveSampleConfig.with_updates |
( |
| self, |
|
|
** | kwargs ) |
Return a copy with updated fields.
Definition at line 1430 of file models.py.
◆ model_config
| qbcompiler.configs.models.SaveSampleConfig.model_config |
|
static |
Initial value:= ConfigDict(
populate_by_name=True,
extra="forbid",
)
Definition at line 1401 of file models.py.
◆ apply
| bool qbcompiler.configs.models.SaveSampleConfig.apply = Field(default=False, description="Enable sample data saving") |
|
static |
◆ mode
| str qbcompiler.configs.models.SaveSampleConfig.mode |
|
static |
Initial value:= Field(
default="infer",
description="Inference mode: infer (standard) or inferWithCache (LLM cache models)",
)
Definition at line 1407 of file models.py.
◆ batch_size
| int qbcompiler.configs.models.SaveSampleConfig.batch_size |
|
static |
Initial value:= Field(
default=1,
alias="batchSize",
description="Number of inference batches to generate",
)
Definition at line 1411 of file models.py.
◆ batch_seq_lens
| Any qbcompiler.configs.models.SaveSampleConfig.batch_seq_lens |
|
static |
Initial value:= Field(
default=[],
alias="batchSeqLens",
description="Per-batch step-wise sequence lengths for inferWithCache mode. e.g. [[80, 1], [240, 10]]",
)
Definition at line 1416 of file models.py.
◆ save_folder
| str qbcompiler.configs.models.SaveSampleConfig.save_folder |
|
static |
Initial value:= Field(
default="sampleInout",
alias="saveFolder",
description="Output folder for sample data",
)
Definition at line 1421 of file models.py.
◆ dtype
| str qbcompiler.configs.models.SaveSampleConfig.dtype |
|
static |
Initial value:= Field(
default="float", description="Data type for saved samples: float or int8"
)
Definition at line 1426 of file models.py.
The documentation for this class was generated from the following file:
1.14.0