qbcompiler.configs.models.ResourceManagementConfig Class Reference

qbcompiler.configs.models.ResourceManagementConfig Class Reference#

Mobilint SDK qb Compiler: qbcompiler.configs.models.ResourceManagementConfig Class Reference
Mobilint SDK qb Compiler v1.4
MCS002-KR
qbcompiler.configs.models.ResourceManagementConfig Class Reference

Configuration for resource management during model compilation. More...

Inheritance diagram for qbcompiler.configs.models.ResourceManagementConfig:

Classes

class  WeightMemory
 Weight memory management configuration. More...

Public Member Functions

"ResourceManagementConfig" with_updates (self, **kwargs)
 Return a copy with updated fields.

Static Public Attributes

 model_config
str weight_dtype
int gpu_memory_budget_mb
 WeightMemory
 default_factory
 alias

Detailed Description

Configuration for resource management during model compilation.

Controls GPU and memory management settings during the compilation process.

Parameters
weight_dtypestr. Weight data type for calibration (e.g., 'float32', 'float16')
gpu_memory_budget_mbint. Device memory budget for weight quantization in MiB; 0 = unlimited, -1 = auto
weight_memoryWeightMemory. Weight memory management configuration

Definition at line 96 of file models.py.

Member Function Documentation

◆ with_updates()

"ResourceManagementConfig" qbcompiler.configs.models.ResourceManagementConfig.with_updates ( self,
** kwargs )

Return a copy with updated fields.

Definition at line 145 of file models.py.

Member Data Documentation

◆ model_config

qbcompiler.configs.models.ResourceManagementConfig.model_config
static
Initial value:
= ConfigDict(
populate_by_name=True,
extra="forbid",
)

Definition at line 107 of file models.py.

◆ weight_dtype

str qbcompiler.configs.models.ResourceManagementConfig.weight_dtype
static
Initial value:
= Field(
default="float32",
alias="weightDtype",
description="Weight data type for calibration (e.g., 'float32', 'float16')",
)

Definition at line 112 of file models.py.

◆ gpu_memory_budget_mb

int qbcompiler.configs.models.ResourceManagementConfig.gpu_memory_budget_mb
static
Initial value:
= Field(
default=-1,
alias="gpuMemoryBudgetMB",
description="Device memory budget for weight quantization in MiB; 0 = unlimited, -1 = auto",
)

Definition at line 117 of file models.py.

◆ WeightMemory

qbcompiler.configs.models.ResourceManagementConfig.WeightMemory
static

Definition at line 141 of file models.py.

◆ default_factory

qbcompiler.configs.models.ResourceManagementConfig.default_factory
static

Definition at line 142 of file models.py.

◆ alias

qbcompiler.configs.models.ResourceManagementConfig.alias
static

Definition at line 142 of file models.py.


The documentation for this class was generated from the following file: