BatchParam¶ #include <qbruntime/type.h> struct mobilint::BatchParam Struct containing BatchLLM parameters. Attributes¶ Member Description sequence_length cache_size cache_id sequence_length¶ int sequence_length cache_size¶ int cache_size cache_id¶ int cache_id Markdown llms.txt