Invention Grant
- Patent Title: Dynamic code loading for multiple executions on a sequential processor
-
Application No.: US16457268Application Date: 2019-06-28
-
Publication No.: US11461622B2Publication Date: 2022-10-04
- Inventor: Samuel Jacob , Ilya Minkin , Mohammad El-Shabani
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US WA Seattle
- Assignee: Amazon Technologies, Inc.
- Current Assignee: Amazon Technologies, Inc.
- Current Assignee Address: US WA Seattle
- Agency: Kilpatrick Townsend & Stockton LLP
- Main IPC: G06F1/00
- IPC: G06F1/00 ; G06N3/063 ; G06N5/04

Abstract:
Embodiments include techniques for enabling execution of N inferences on an execution engine of a neural network device. Instruction code for a single inference is stored in a memory that is accessible by a DMA engine, the instruction code forming a regular code block. A NOP code block and a reset code block for resetting an instruction DMA queue are stored in the memory. The instruction DMA queue is generated such that, when it is executed by the DMA engine, it causes the DMA engine to copy, for each of N inferences, both the regular code block and an additional code block to an instruction buffer. The additional code block is the NOP code block for the first N−1 inferences and is the reset code block for the Nth inference. When the reset code block is executed by the execution engine, the instruction DMA queue is reset.
Information query