콘텐츠로 이동

BufferInfo

#include <qbruntime/type.h>

struct mobilint::BufferInfo

Struct representing input/output buffer information.

Attributes

Member Description
original_height
original_width
original_channel
reshaped_height
reshaped_width
reshaped_channel
height
width
channel
max_height
max_width
max_channel
max_cache_size

original_height

uint32_t original_height

Height of original input/output

original_width

uint32_t original_width

Width of original input/output

original_channel

uint32_t original_channel

Channel of original input/output

reshaped_height

uint32_t reshaped_height

Height of reshaped input/output

reshaped_width

uint32_t reshaped_width

Width of reshaped input/output

reshaped_channel

uint32_t reshaped_channel

Channel of reshaped input/output

height

uint32_t height

Height of NPU input/output

width

uint32_t width

Width of NPU input/output

channel

uint32_t channel

Channel of NPU input/output

max_height

uint32_t max_height

Maximum height of original input/output if data is sequential.

max_width

uint32_t max_width

Maximum width of original input/output if data is sequential.

max_channel

uint32_t max_channel

Maximum channel of original input/output if data is sequential.

max_cache_size

uint32_t max_cache_size

Maximum KV-cache size, relevant for LLM models using KV cache.

Member functions

Member Description
original_size Returns the total size of the original input/output.
reshaped_size Returns the total size of the reshaped input/output.
size Returns the total size of the NPU input/output.

original_size

uint32_t original_size() const

Returns the total size of the original input/output.

Returns

The data size.

reshaped_size

uint32_t reshaped_size() const

Returns the total size of the reshaped input/output.

Returns

The data size.

size

uint32_t size() const

Returns the total size of the NPU input/output.

Returns

The data size.