qbruntime.type.CacheInfo Class Reference

qbruntime.type.CacheInfo Class Reference#

SDK qb Runtime Library: qbruntime.type.CacheInfo Class Reference

SDK qb Runtime Library v1.2

MCS001-EN

qbruntime
type
CacheInfo

Struct representing KV-cache information. More...

Public Member Functions
	__init__ (self, CacheType cache_type=CacheType.Error, str name="", str layer_hash="", int size=0, int num_batches=0)
	from_cpp (cls, _cQbRuntime.CacheInfo _cache_info)
CacheType	cache_type (self)
str	name (self)
str	layer_hash (self)
int	size (self)
int	num_batches (self)
	cache_type (self, CacheType value)
	name (self, str value)
	layer_hash (self, str value)
	size (self, int value)
	num_batches (self, int value)

Protected Attributes
	_cache_info = _cQbRuntime.CacheInfo()

Detailed Description

Struct representing KV-cache information.

Definition at line 762 of file type.py.

Constructor & Destructor Documentation

◆ init()

qbruntime.type.CacheInfo.__init__	(		self,
		CacheType	cache_type = CacheType.Error,
		str	name = "",
		str	layer_hash = "",
		int	size = 0,
		int	num_batches = 0 )

Definition at line 765 of file type.py.

Member Function Documentation

◆ from_cpp()

qbruntime.type.CacheInfo.from_cpp	(		cls,
		_cQbRuntime.CacheInfo	_cache_info )

Definition at line 781 of file type.py.

◆ cache_type() [1/2]

CacheType qbruntime.type.CacheInfo.cache_type ( self )

Definition at line 791 of file type.py.

◆ name() [1/2]

str qbruntime.type.CacheInfo.name ( self )

Definition at line 795 of file type.py.

◆ layer_hash() [1/2]

str qbruntime.type.CacheInfo.layer_hash ( self )

Definition at line 799 of file type.py.

◆ size() [1/2]

int qbruntime.type.CacheInfo.size ( self )

Definition at line 803 of file type.py.

◆ num_batches() [1/2]

int qbruntime.type.CacheInfo.num_batches ( self )

Definition at line 807 of file type.py.

◆ cache_type() [2/2]

qbruntime.type.CacheInfo.cache_type	(		self,
		CacheType	value )

Definition at line 811 of file type.py.

◆ name() [2/2]

qbruntime.type.CacheInfo.name	(		self,
		str	value )

Definition at line 815 of file type.py.

◆ layer_hash() [2/2]

qbruntime.type.CacheInfo.layer_hash	(		self,
		str	value )

Definition at line 819 of file type.py.

◆ size() [2/2]

qbruntime.type.CacheInfo.size	(		self,
		int	value )

Definition at line 823 of file type.py.

◆ num_batches() [2/2]

qbruntime.type.CacheInfo.num_batches	(		self,
		int	value )

Definition at line 827 of file type.py.

Member Data Documentation

◆ _cache_info

qbruntime.type.CacheInfo._cache_info = _cQbRuntime.CacheInfo()

protected

Definition at line 773 of file type.py.

The documentation for this class was generated from the following file:

type.py