BatchParam Struct Reference

SDK qb Runtime Library v1.2 MCS001-

• mobilint
• BatchParam

Public Attributes | List of all members

mobilint::BatchParam Struct Reference

C++ API Reference

Struct containing BatchLLM parameters. More...

#include <type.h>

Public Attributes
int	sequence_length
int	cache_size
int	cache_id

Detailed Description

Struct containing BatchLLM parameters.

Definition at line 513 of file type.h.

Member Data Documentation

◆ sequence_length

int mobilint::BatchParam::sequence_length

Definition at line 514 of file type.h.

◆ cache_size

int mobilint::BatchParam::cache_size

Definition at line 515 of file type.h.

◆ cache_id

int mobilint::BatchParam::cache_id

Definition at line 516 of file type.h.

---

The documentation for this struct was generated from the following file:

• type.h

---

Generated by  1.14.0