CacheInfo Struct Reference

SDK qb Runtime Library v1.0 MCS001-

• mobilint
• CacheInfo

Public Attributes | List of all members

mobilint::CacheInfo Struct Reference

C++ API Reference

Struct representing KV-cache information. More...

#include <type.h>

Public Attributes
CacheType	cache_type = CacheType::Error
std::string	name
std::string	layer_hash
uint64_t	size = 0
size_t	num_batches = 0

Detailed Description

Struct representing KV-cache information.

Definition at line 481 of file type.h.

Member Data Documentation

◆ cache_type

CacheType mobilint::CacheInfo::cache_type = CacheType::Error

Definition at line 482 of file type.h.

◆ name

std::string mobilint::CacheInfo::name

Definition at line 483 of file type.h.

◆ layer_hash

std::string mobilint::CacheInfo::layer_hash

Definition at line 484 of file type.h.

◆ size

uint64_t mobilint::CacheInfo::size = 0

Definition at line 485 of file type.h.

◆ num_batches

size_t mobilint::CacheInfo::num_batches = 0

Definition at line 486 of file type.h.

---

The documentation for this struct was generated from the following file:

• type.h

---

Generated by  1.14.0