公开(公告)号：US20200167193A1

公开(公告)日：2020-05-28

申请号：US16776338

申请日：2020-01-29

Applicant: Apple Inc.

Inventor： Francesco ROSSI ,  Gaurav KAPOOR ,  Michael R. SIRACUSA ,  William B. MARCH

IPC: G06F9/50 ,  G06F8/41 ,  G06N3/02 ,  G06N3/063

Abstract: The subject technology provides for dynamic task allocation for neural network models. The subject technology determines an operation performed at a node of a neural network model. The subject technology assigns an annotation to indicate whether the operation is better performed on a CPU or a GPU based at least in part on hardware capabilities of a target platform. The subject technology determines whether the neural network model includes a second layer. The subject technology, in response to determining that the neural network model includes a second layer, for each node of the second layer of the neural network model, determines a second operation performed at the node. Further the subject technology assigns a second annotation to indicate whether the second operation is better performed on the CPU or the GPU based at least in part on the hardware capabilities of the target platform.

公开(公告)号：US20230176907A1

公开(公告)日：2023-06-08

申请号：US18074440

申请日：2022-12-02

Applicant: Apple Inc.

Inventor： Francesco ROSSI ,  Gaurav KAPOOR ,  Michael R. SIRACUSA ,  William B. MARCH

IPC: G06F9/50 ,  G06N3/063 ,  G06F8/41 ,  G06F9/48 ,  G06N3/02

CPC classification number: G06F9/50 ,  G06F9/5044 ,  G06N3/063 ,  G06F8/451 ,  G06F9/485 ,  G06F9/5038 ,  G06N3/02 ,  G06F2209/509

Abstract: The subject technology provides for dynamic task allocation for neural network models. The subject technology determines an operation performed at a node of a neural network model. The subject technology assigns an annotation to indicate whether the operation is better performed on a CPU or a GPU based at least in part on hardware capabilities of a target platform. The subject technology determines whether the neural network model includes a second layer. The subject technology, in response to determining that the neural network model includes a second layer, for each node of the second layer of the neural network model, determines a second operation performed at the node. Further the subject technology assigns a second annotation to indicate whether the second operation is better performed on the CPU or the GPU based at least in part on the hardware capabilities of the target platform.