CacheInfo Struct Reference

CacheInfo Struct Reference#

Runtime Library: mobilint::CacheInfo Struct Reference
Runtime Library v0.30
Mobilint SDK qb
mobilint::CacheInfo Struct Reference

Struct representing KV-cache information. More...

#include <type.h>

Public Attributes

CacheType cache_type = CacheType::Error
std::string name
std::string layer_hash
uint64_t size = 0
size_t num_batches = 0

Detailed Description

Struct representing KV-cache information.

Definition at line 489 of file type.h.

Member Data Documentation

◆ cache_type

CacheType mobilint::CacheInfo::cache_type = CacheType::Error

Definition at line 490 of file type.h.

◆ name

std::string mobilint::CacheInfo::name

Definition at line 491 of file type.h.

◆ layer_hash

std::string mobilint::CacheInfo::layer_hash

Definition at line 492 of file type.h.

◆ size

uint64_t mobilint::CacheInfo::size = 0

Definition at line 493 of file type.h.

◆ num_batches

size_t mobilint::CacheInfo::num_batches = 0

Definition at line 494 of file type.h.


The documentation for this struct was generated from the following file: