Accelerator¶
Represents an accelerator, i.e., an NPU, used for executing models.
Static functions¶
| Member | Description |
|---|---|
create ×3 |
Creates an Accelerator object for executing models, using device number 0. |
create¶
Creates an Accelerator object for executing models, using device number 0.
This function is useful when only one device is attached, in which case the default device (device 0) will be used.
Parameters
sc[out] — Reference to a StatusCode that will be updated with the result of the creation.
Returns
A unique pointer to the created Accelerator object.
Creates an Accelerator object for a specific device.
The dev_no parameter represents the device number. For example, on Linux, if an ARIES NPU is attached as /dev/aries0, the device number is 0.
Parameters
dev_no— The device number to associate with the Accelerator.sc[out] — Reference to a StatusCode that will be updated with the result of the creation.
Returns
A unique pointer to the created Accelerator object.
Deprecated
Use std::unique_ptr<Accelerator> create(int dev_no, StatusCode& sc) instead.
Member functions¶
| Member | Description |
|---|---|
Accelerator ×2 |
|
operator= ×2 |
|
allocatePinnedMemory |
Allocates a pinned (zero-copy) memory buffer on the NPU device. |
Accelerator¶
operator=¶
allocatePinnedMemory¶
template <typename T>
PinnedMemory<T> allocatePinnedMemory(const std::vector<int64_t> &shape, StatusCode &sc)
Allocates a pinned (zero-copy) memory buffer on the NPU device.
The returned buffer is mapped into both host and NPU address space so that inference can read/write it directly without an intermediate copy. Only supported on Regulus SoC hardware (excluding USB); other targets return Model_IsNotSupportedHardware.
Template parameters
T— Element type of the buffer. Currently onlyuint8_tandfloatare supported.
Parameters
shape[in] — Buffer shape. All dimensions must be positive.sc[out] — Reference to a StatusCode that will be updated with the result of the allocation.
Returns
The allocated PinnedMemory handle. On failure the handle is empty and sc holds the error code.