CacheInfo Struct Reference

Runtime Library v0.30 Mobilint SDK qb

• mobilint
• CacheInfo

Public Attributes | List of all members

mobilint::CacheInfo Struct Reference

C++ API Reference

Struct representing KV-cache information. More...

#include <type.h>

Public Attributes
CacheType	cache_type = CacheType::Error
std::string	name
std::string	layer_hash
uint64_t	size = 0
size_t	num_batches = 0

Detailed Description

Struct representing KV-cache information.

Definition at line 489 of file type.h.

Member Data Documentation

◆ cache_type

CacheType mobilint::CacheInfo::cache_type = CacheType::Error

Definition at line 490 of file type.h.

◆ name

std::string mobilint::CacheInfo::name

Definition at line 491 of file type.h.

◆ layer_hash

std::string mobilint::CacheInfo::layer_hash

Definition at line 492 of file type.h.

◆ size

uint64_t mobilint::CacheInfo::size = 0

Definition at line 493 of file type.h.

◆ num_batches

size_t mobilint::CacheInfo::num_batches = 0

Definition at line 494 of file type.h.

---

The documentation for this struct was generated from the following file:

• type.h

---

Generated by  1.14.0