BatchParam¶ class BatchParam Struct containing BatchLLM parameters. Attributes¶ Name Description sequence_length cache_size cache_id sequence_length¶ property sequence_length: int cache_size¶ property cache_size: int cache_id¶ property cache_id: int Methods¶ Name Description __init__ __repr__ __init__¶ def __init__( self, sequence_length: int = 0, cache_size: int = 0, cache_id: int = 0, ) __repr__¶ def __repr__(self) Markdown llms.txt