公开(公告)号：US11915141B2

公开(公告)日：2024-02-27

申请号：US16988737

申请日：2020-08-10

Applicant: Korea Advanced Institute of Science and Technology

Inventor： Hoi Jun Yoo ,  Dong Hyeon Han

IPC: G06N3/08 ,  G06N3/084 ,  G06N5/046

CPC classification number: G06N3/084 ,  G06N5/046

Abstract: Disclosed herein are an apparatus and method for training a deep neural network. An apparatus for training a deep neural network including N layers, each having multiple neurons, includes an error propagation processing unit configured to, when an error occurs in an N-th layer in response to initiation of training of the deep neural network, determine an error propagation value for an arbitrary layer based on the error occurring in the N-th layer and directly propagate the error propagation value to the arbitrary layer, a weight gradient update processing unit configured to update a forward weight for the arbitrary layer based on a feed-forward value input to the arbitrary layer and the error propagation value in response to the error propagation value, and a feed-forward processing unit configured to, when update of the forward weight is completed, perform a feed-forward operation in the arbitrary layer using the forward weight.