公开(公告)号：US20210192337A1

公开(公告)日：2021-06-24

申请号：US16724849

申请日：2019-12-23

Applicant: Arm Limited

Inventor： Danny Daysang Loh ,  Lingchuan Meng ,  Naveen Suda ,  Eric Kunze ,  Ahmet Fatih Inci

IPC: G06N3/08 ,  G06N3/04 ,  G06N3/063

Abstract: The present disclosure advantageously provides a heterogenous system, and a method for generating an artificial neural network (ANN) for a heterogenous system. The heterogenous system includes a plurality of processing units coupled to a memory configured to store an input volume. The plurality of processing units includes first and second processing units. The first processing unit includes a first processor and is configured to execute a first ANN, and the second processing unit includes a second processor and is configured to execute a second ANN. The first and second ANNs respectively include an input layer, at least one processor-optimized hidden layer and an output layer. The second ANN hidden layers are different than the first ANN hidden layers.

公开(公告)号：US11620516B2

公开(公告)日：2023-04-04

申请号：US16724849

申请日：2019-12-23

Applicant: Arm Limited

Inventor： Danny Daysang Loh ,  Lingchuan Meng ,  Naveen Suda ,  Eric Kunze ,  Ahmet Fatih Inci

IPC: G06N3/08 ,  G06N20/10 ,  G06N3/063 ,  G06N3/04 ,  G06N20/00 ,  G06N20/20

Abstract: The present disclosure advantageously provides a heterogenous system, and a method for generating an artificial neural network (ANN) for a heterogenous system. The heterogenous system includes a plurality of processing units coupled to a memory configured to store an input volume. The plurality of processing units includes first and second processing units. The first processing unit includes a first processor and is configured to execute a first ANN, and the second processing unit includes a second processor and is configured to execute a second ANN. The first and second ANNs respectively include an input layer, at least one processor-optimized hidden layer and an output layer. The second ANN hidden layers are different than the first ANN hidden layers.

公开(公告)号：US20230376745A1

公开(公告)日：2023-11-23

申请号：US17751089

申请日：2022-05-23

Applicant: Arm Limited

Inventor： Kartikeya Bhardwaj ,  Guihong Li ,  Naveen Suda ,  Milos Milosavljevic ,  Danny Daysang Loh

IPC: G06N3/08 ,  G06N3/04

CPC classification number: G06N3/08 ,  G06N3/04

Abstract: A mechanism to control the stability and performance of weight-sharing methods for designing neural networks is provided. Network weights and architecture parameters of a super-net, including multiple sub-networks, are adjusted to reduce a loss determined, at least in part, from a sum, over layers of the sub-network, of measures of smoothness based on network weights in the layers. A sub-network of the super-net is selected dependent upon the adjusted architectural parameters.

公开(公告)号：US20230196093A1

公开(公告)日：2023-06-22

申请号：US17559163

申请日：2021-12-22

Applicant: Arm Limited

Inventor： Kartikeya Bhardwaj ,  Naveen Suda ,  Lingchuan Meng ,  Alexander Eugene Chalfin ,  Danny Daysang Log

IPC: G06N3/08

CPC classification number: G06N3/08

Abstract: Disclosed is a novel neural network architecture and methods for generating neural network-based models from such architecture. A first version of the neural network, that is used for training purposes, includes one or more blocks in a first format that can then be replaced with corresponding blocks in a second format for execution. An executable model can thus be provided comprising a second version of the neural network including the one or more blocks in the second format. This then allows the training to be performed in a first, e.g. expanded format, but with a second, e.g. reduced, format model then provided for execution.