公开(公告)号：US12182619B2

公开(公告)日：2024-12-31

申请号：US18074440

申请日：2022-12-02

Applicant: Apple Inc.

Inventor： Francesco Rossi ,  Gaurav Kapoor ,  Michael R. Siracusa ,  William B. March

IPC: G06F9/46 ,  G06F8/41 ,  G06F9/48 ,  G06F9/50 ,  G06N3/02 ,  G06N3/063

Abstract: The subject technology provides for dynamic task allocation for neural network models. The subject technology determines an operation performed at a node of a neural network model. The subject technology assigns an annotation to indicate whether the operation is better performed on a CPU or a GPU based at least in part on hardware capabilities of a target platform. The subject technology determines whether the neural network model includes a second layer. The subject technology, in response to determining that the neural network model includes a second layer, for each node of the second layer of the neural network model, determines a second operation performed at the node. Further the subject technology assigns a second annotation to indicate whether the second operation is better performed on the CPU or the GPU based at least in part on the hardware capabilities of the target platform.

公开(公告)号：US10585703B2

公开(公告)日：2020-03-10

申请号：US15721716

申请日：2017-09-29

Applicant: Apple Inc.

Inventor： Francesco Rossi ,  Gaurav Kapoor ,  Michael R. Siracusa ,  William B. March

IPC: G06F8/41 ,  G06F9/50 ,  G06N3/063 ,  G06N3/02

Abstract: The subject technology provides for dynamic task allocation for neural network models. The subject technology determines an operation performed at a node of a neural network model. The subject technology assigns an annotation to indicate whether the operation is better performed on a CPU or a GPU based at least in part on hardware capabilities of a target platform. The subject technology determines whether the neural network model includes a second layer. The subject technology, in response to determining that the neural network model includes a second layer, for each node of the second layer of the neural network model, determines a second operation performed at the node. Further the subject technology assigns a second annotation to indicate whether the second operation is better performed on the CPU or the GPU based at least in part on the hardware capabilities of the target platform.

公开(公告)号：US11520629B2

公开(公告)日：2022-12-06

申请号：US16776338

申请日：2020-01-29

Applicant: Apple Inc.

Inventor： Francesco Rossi ,  Gaurav Kapoor ,  Michael R. Siracusa ,  William B. March

IPC: G06F9/46 ,  G06F9/50 ,  G06N3/063 ,  G06F8/41 ,  G06F9/48 ,  G06N3/02

Abstract: The subject technology provides for dynamic task allocation for neural network models. The subject technology determines an operation performed at a node of a neural network model. The subject technology assigns an annotation to indicate whether the operation is better performed on a CPU or a GPU based at least in part on hardware capabilities of a target platform. The subject technology determines whether the neural network model includes a second layer. The subject technology, in response to determining that the neural network model includes a second layer, for each node of the second layer of the neural network model, determines a second operation performed at the node. Further the subject technology assigns a second annotation to indicate whether the second operation is better performed on the CPU or the GPU based at least in part on the hardware capabilities of the target platform.

公开(公告)号：US20180349189A1

公开(公告)日：2018-12-06

申请号：US15721716

申请日：2017-09-29

Applicant: Apple Inc.

Inventor： Francesco Rossi ,  Gaurav Kapoor ,  Michael R. Siracusa ,  William B. March

IPC: G06F9/50 ,  G06N3/02

Abstract: The subject technology provides for dynamic task allocation for neural network models. The subject technology determines an operation performed at a node of a neural network model. The subject technology assigns an annotation to indicate whether the operation is better performed on a CPU or a GPU based at least in part on hardware capabilities of a target platform. The subject technology determines whether the neural network model includes a second layer. The subject technology, in response to determining that the neural network model includes a second layer, for each node of the second layer of the neural network model, determines a second operation performed at the node. Further the subject technology assigns a second annotation to indicate whether the second operation is better performed on the CPU or the GPU based at least in part on the hardware capabilities of the target platform.