BufferInfo¶
Struct representing input/output buffer information.
Attributes¶
| Member | Description |
|---|---|
original_height |
|
original_width |
|
original_channel |
|
reshaped_height |
|
reshaped_width |
|
reshaped_channel |
|
height |
|
width |
|
channel |
|
max_height |
|
max_width |
|
max_channel |
|
max_cache_size |
original_height¶
Height of original input/output
original_width¶
Width of original input/output
original_channel¶
Channel of original input/output
reshaped_height¶
Height of reshaped input/output
reshaped_width¶
Width of reshaped input/output
reshaped_channel¶
Channel of reshaped input/output
height¶
Height of NPU input/output
width¶
Width of NPU input/output
channel¶
Channel of NPU input/output
max_height¶
Maximum height of original input/output if data is sequential.
max_width¶
Maximum width of original input/output if data is sequential.
max_channel¶
Maximum channel of original input/output if data is sequential.
max_cache_size¶
Maximum KV-cache size, relevant for LLM models using KV cache.
Member functions¶
| Member | Description |
|---|---|
original_size |
Returns the total size of the original input/output. |
reshaped_size |
Returns the total size of the reshaped input/output. |
size |
Returns the total size of the NPU input/output. |
original_size¶
Returns the total size of the original input/output.
Returns
The data size.
reshaped_size¶
Returns the total size of the reshaped input/output.
Returns
The data size.
size¶
Returns the total size of the NPU input/output.
Returns
The data size.