# BatchParam

```cpp
#include <qbruntime/type.h>

struct mobilint::BatchParam
```

Struct containing BatchLLM parameters.

## Attributes

| Member | Description |
| --- | --- |
| [`sequence_length`](<#sequence-length>) |  |
| [`cache_size`](<#cache-size>) |  |
| [`cache_id`](<#cache-id>) |  |

### sequence\_length

```cpp
int sequence_length
```

### cache\_size

```cpp
int cache_size
```

### cache\_id

```cpp
int cache_id
```
