公开(公告)号：US12079661B2

公开(公告)日：2024-09-03

申请号：US18491695

申请日：2023-10-20

Applicant: Rebellions Inc.

Inventor： Wongyu Shin ,  Miock Chi ,  Hongyun Kim ,  Jinwook Oh ,  Juyeong Yoon

IPC: G06F9/48 ,  G06F9/38

CPC classification number: G06F9/4881 ,  G06F9/3838

Abstract: A neural processing device and a method for managing tasks thereof are provided. The neural processing device includes a neural core configured to perform a task and generate a completion signal for completion of the task, a core global configured to transfer task information for the task to the neural core and receive the completion signal of the task from the neural core, and a task manager configured to generate and transmit the task information to the core global, receive the completion signal from the core global, generate a completion report, and transmit the completion report.

公开(公告)号：US20240330665A1

公开(公告)日：2024-10-03

申请号：US18622228

申请日：2024-03-29

Applicant: REBELLIONS INC.

Inventor： Hongyun Kim ,  Miock Chi

IPC: G06N3/063

CPC classification number: G06N3/063

Abstract: An apparatus comprising neural processors, a command processor, and a shared memory is provided. The command processor, in response to receiving a context start signal indicating a start of a context of a neural network model from a host system, directly accesses a memory in the host system to read neural network model data for the context of the neural network model. The command processor, based on a determination on whether the plurality of task descriptors for the previous context of the neural network model are not allowed to be reused for the plurality of task descriptors for the current context of the neural network model, generates the plurality of task descriptors for the current context of the neural network model.

公开(公告)号：US20240330085A1

公开(公告)日：2024-10-03

申请号：US18621895

申请日：2024-03-29

Applicant: REBELLIONS INC.

Inventor： Hongyun Kim

IPC: G06F9/48 ,  G06F9/30 ,  G06F15/173

CPC classification number: G06F9/544 ,  G06F9/461 ,  G06F9/4812 ,  G06F9/4881 ,  G06F9/5027 ,  G06F9/5066 ,  G06F2209/486 ,  G06F2209/5017

Abstract: An apparatus comprising neural processors, a command processor, and a shared memory. The command processor receives a context start signal indicating a start of a context of a neural network model from a host system. The command processor determines whether neural network model data is entirely or partially updated based on the context start signal. The command processor updates the neural network model data in the shared memory based on a determination on whether neural network model data is entirely or partially updated based on the context start signal. The command processor generates a plurality of task descriptors describing neural network model tasks based on the neural network model data, and distributes the plurality of task descriptors to the neural processors.

公开(公告)号：US20240330041A1

公开(公告)日：2024-10-03

申请号：US18621936

申请日：2024-03-29

Applicant: REBELLIONS INC.

Inventor： Hongyun Kim ,  Chang-Hyo Yu ,  Yoonho Boo

IPC: G06F9/48 ,  G06F9/54 ,  G06F12/0831

CPC classification number: G06F9/4856 ,  G06F9/544 ,  G06F12/0835

Abstract: A command processor determines whether a command descriptor describing a current command is in a first format or in a second format, wherein the first format includes a source memory address pointing to a memory area in a shared memory having a binary code to be accessed according to direct memory access (DMA) scheme, and the second format includes one or more object indices, a respective one of the one or more object indices indicating an object in an object database. If the command descriptor describing the current command is in the second format, the command processor converts a format of the command descriptor to the first format, generates one or more task descriptors describing neural network model tasks based on the command descriptor in the first format, and distributes the one or more task descriptors to the one or more neural processors.

公开(公告)号：US12164967B2

公开(公告)日：2024-12-10

申请号：US18622214

申请日：2024-03-29

Applicant: REBELLIONS INC.

Inventor： Hongyun Kim

IPC: G06F9/50 ,  G06F9/48

Abstract: An apparatus comprising neural processors, a command processor, and a shared memory is provided. The command processor, in response to receiving a context start signal indicating a start of a context of a neural network model from a host system, directly accesses a memory in the host system to read command stream data for the neural network model. The command processor selects a current command and determines whether the current command is a branch command or a command describing neural network model tasks. The command processor selects a command among commands in the command stream data as a next command to be executed, based on a determination on whether the current command is the branch command or the command describing neural network model tasks.

公开(公告)号：US20240330059A1

公开(公告)日：2024-10-03

申请号：US18622214

申请日：2024-03-29

Applicant: REBELLIONS INC.

Inventor： Hongyun Kim

IPC: G06F9/48 ,  G06F9/30

CPC classification number: G06F9/5027 ,  G06F9/4881 ,  G06F9/5066 ,  G06F2209/5017

Abstract: An apparatus comprising neural processors, a command processor, and a shared memory is provided. The command processor, in response to receiving a context start signal indicating a start of a context of a neural network model from a host system, directly accesses a memory in the host system to read command stream data for the neural network model. The command processor selects a current command and determines whether the current command is a branch command or a command describing neural network model tasks. The command processor selects a command among commands in the command stream data as a next command to be executed, based on a determination on whether the current command is the branch command or the command describing neural network model tasks.

公开(公告)号：US12032996B2

公开(公告)日：2024-07-09

申请号：US18491695

申请日：2023-10-20

Applicant: Rebellions Inc.

Inventor： Wongyu Shin ,  Miock Chi ,  Hongyun Kim ,  Jinwook Oh ,  Juyeong Yoon

IPC: G06F9/48 ,  G06F9/38

CPC classification number: G06F9/4881 ,  G06F9/3838

Abstract: A neural processing device and a method for managing tasks thereof are provided. The neural processing device includes a neural core configured to perform a task and generate a completion signal for completion of the task, a core global configured to transfer task information for the task to the neural core and receive the completion signal of the task from the neural core, and a task manager configured to generate and transmit the task information to the core global, receive the completion signal from the core global, generate a completion report, and transmit the completion report.

公开(公告)号：US12229587B2

公开(公告)日：2025-02-18

申请号：US18621936

申请日：2024-03-29

Applicant: REBELLIONS INC.

Inventor： Hongyun Kim ,  Chang-Hyo Yu ,  Yoonho Boo

IPC: G06F9/48 ,  G06F9/54 ,  G06F12/0831

Abstract: A command processor determines whether a command descriptor describing a current command is in a first format or in a second format, wherein the first format includes a source memory address pointing to a memory area in a shared memory having a binary code to be accessed according to direct memory access (DMA) scheme, and the second format includes one or more object indices, a respective one of the one or more object indices indicating an object in an object database. If the command descriptor describing the current command is in the second format, the command processor converts a format of the command descriptor to the first format, generates one or more task descriptors describing neural network model tasks based on the command descriptor in the first format, and distributes the one or more task descriptors to the one or more neural processors.

公开(公告)号：US20240329683A1

公开(公告)日：2024-10-03

申请号：US18612806

申请日：2024-03-21

Applicant: REBELLIONS INC.

Inventor： Hongyun Kim

IPC: G06F1/06

CPC classification number: G06F1/06

Abstract: Provided are a neural processor, a neural processing device, and a clock gating method thereof, which perform clock gating for a plurality of compute units based on a data flow architecture, in which the neural processor includes at least one neural core that processes at least one task, and a clock controller that selectively gates, according to a data flow architecture of the at least one task, a clock signal provided to the at least one neural core.

公开(公告)号：US20240320037A1

公开(公告)日：2024-09-26

申请号：US18674752

申请日：2024-05-24

Applicant: Rebellions Inc.

Inventor： Wongyu Shin ,  Miock Chi ,  Hongyun Kim ,  Jinwook Oh ,  Juyeong Yoon

IPC: G06F9/48 ,  G06F9/38

CPC classification number: G06F9/4881 ,  G06F9/3838

Abstract: A neural processing device and a method for managing tasks thereof are provided. The neural processing device includes a neural core configured to perform a task and generate a completion signal for completion of the task, a core global configured to transfer task information for the task to the neural core and receive the completion signal of the task from the neural core, and a task manager configured to generate and transmit the task information to the core global, receive the completion signal from the core global, generate a completion report, and transmit the completion report.