qbruntime.type.BatchParam Class Reference

qbruntime.type.BatchParam Class Reference#

SDK qb Runtime Library: qbruntime.type.BatchParam Class Reference

SDK qb Runtime Library v1.2

MCS001-EN

qbruntime
type
BatchParam

Struct containing BatchLLM parameters. More...

Public Member Functions
	__init__ (self, int sequence_length=0, int cache_size=0, int cache_id=0)
	__repr__ (self)
int	sequence_length (self)
int	cache_size (self)
int	cache_id (self)
	sequence_length (self, int value)
	cache_size (self, int value)
	cache_id (self, int value)

Protected Attributes
	_batch_param = _cQbRuntime.BatchParam()

Detailed Description

Struct containing BatchLLM parameters.

Definition at line 841 of file type.py.

Constructor & Destructor Documentation

◆ init()

qbruntime.type.BatchParam.__init__	(		self,
		int	sequence_length = 0,
		int	cache_size = 0,
		int	cache_id = 0 )

Definition at line 844 of file type.py.

Member Function Documentation

◆ repr()

qbruntime.type.BatchParam.__repr__ ( self )

Definition at line 855 of file type.py.

◆ sequence_length() [1/2]

int qbruntime.type.BatchParam.sequence_length ( self )

Definition at line 867 of file type.py.

◆ cache_size() [1/2]

int qbruntime.type.BatchParam.cache_size ( self )

Definition at line 871 of file type.py.

◆ cache_id() [1/2]

int qbruntime.type.BatchParam.cache_id ( self )

Definition at line 875 of file type.py.

◆ sequence_length() [2/2]

qbruntime.type.BatchParam.sequence_length	(		self,
		int	value )

Definition at line 879 of file type.py.

◆ cache_size() [2/2]

qbruntime.type.BatchParam.cache_size	(		self,
		int	value )

Definition at line 883 of file type.py.

◆ cache_id() [2/2]

qbruntime.type.BatchParam.cache_id	(		self,
		int	value )

Definition at line 887 of file type.py.

Member Data Documentation

◆ _batch_param

qbruntime.type.BatchParam._batch_param = _cQbRuntime.BatchParam()

protected

Definition at line 850 of file type.py.

The documentation for this class was generated from the following file:

type.py