콘텐츠로 이동

BatchParam

class BatchParam

Struct containing BatchLLM parameters.

Attributes

Name Description
sequence_length
cache_size
cache_id

sequence_length

property sequence_length: int

cache_size

property cache_size: int

cache_id

property cache_id: int

Methods

Name Description
__init__
__repr__

__init__

def __init__(
    self,
    sequence_length: int = 0,
    cache_size: int = 0,
    cache_id: int = 0,
)

__repr__

def __repr__(self)