콘텐츠로 이동

CacheInfo

#include <qbruntime/type.h>

struct mobilint::CacheInfo

Struct representing KV-cache information.

Attributes

Member Description
cache_type
name
layer_hash
size
num_batches

cache_type

CacheType cache_type

name

std::string name

layer_hash

std::string layer_hash

size

uint64_t size

num_batches

size_t num_batches