公开(公告)号：US20230229931A1

公开(公告)日：2023-07-20

申请号：US18186163

申请日：2023-03-18

Applicant: Samsung Electronics Co., Ltd. ,  Seoul National University R&DB Foundation

Inventor： Hyunsun PARK ,  Soonhoi HA ,  Donghyun KANG ,  Jintaek KANG

IPC: G06N3/10 ,  G06N3/063 ,  G06N3/04

CPC classification number: G06N3/10 ,  G06N3/04 ,  G06N3/063

Abstract: A processor-implemented method of a neural network includes obtaining intermediate pooling results, respectively corresponding to sub-pooling kernels obtained by decomposing an original pooling kernel, by performing a pooling operation on input pixels included in a current window in an input feature map with the sub-pooling kernels, obtaining a final pooling result corresponding to the current window by post-processing the intermediate pooling results, and determining an output pixel value of an output feature map, based on the final pooling result, wherein the current window is determined according to the original pooling kernel having been slid, according to a raster scan order, in the input feature map.

公开(公告)号：US20190122106A1

公开(公告)日：2019-04-25

申请号：US16106703

申请日：2018-08-21

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Junhaeng LEE ,  Hyunsun PARK ,  Yeongjae CHOI

IPC: G06N3/08 ,  G06N3/063 ,  G06F7/483

Abstract: A processor-implemented neural network method includes calculating individual update values for a weight assigned to a connection relationship between nodes included in a neural network; generating an accumulated update value by accumulating the individual update values in an accumulation buffer; and training the neural network by updating the weight using the accumulated update value in response to the accumulated update value being equal to or greater than a threshold value.

公开(公告)号：US20240112030A1

公开(公告)日：2024-04-04

申请号：US18529620

申请日：2023-12-05

Applicant: Samsung Electronics Co., Ltd.

Inventor： Junhaeng LEE ,  Hyunsun PARK ,  Sehwan LEE ,  Seungwon LEE

IPC: G06N3/08 ,  G06N3/0495

CPC classification number: G06N3/08 ,  G06N3/0495

Abstract: A neural network method and apparatus is provided. A processor-implemented neural network method includes a processor and a memory storing information, including stored predetermined precision parameters of a layer of a n neural network, about the layer, the method includes obtaining information about the layer in the memory indicative of the number of output classes; determining, based on the obtained information, a precision for the layer based on the number of output classes of the layer, wherein the precision is determined proportionally with respect to the obtained number of output classes; and processing new parameters, with a set precision, for the layer based on the stored parameter.

公开(公告)号：US20210174178A1

公开(公告)日：2021-06-10

申请号：US16896500

申请日：2020-06-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Hyunsun PARK ,  Yoojin KIM ,  Junwoo JANG

IPC: G06N3/063 ,  G06K9/62

Abstract: A method of processing data includes manipulating input data based on a configuration of the input data and a configuration of hardware for processing the input data to generate manipulated data; rearranging the manipulated data based on sparsity of the manipulated data to generate rearranged data; and processing the rearranged data to generate output data.

公开(公告)号：US20240095532A1

公开(公告)日：2024-03-21

申请号：US18522982

申请日：2023-11-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Hyunsun PARK ,  Yoojin KIM ,  Hyeongseok YU ,  Sehwan LEE ,  Junwoo JANG

IPC: G06N3/08 ,  G06N3/04

CPC classification number: G06N3/08 ,  G06N3/04

Abstract: A method of processing data includes identifying a sparsity among information, included in input data, based on valid information or invalid information included in the input data, rearranging the input data based on the sparsity among the information indicating a distribution of the invalid values included in the input data, and generating, by performing an operation on the rearranged input data in the neural network, an output data.

公开(公告)号：US20220342833A1

公开(公告)日：2022-10-27

申请号：US17858506

申请日：2022-07-06

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Hyunsun PARK ,  Jun-Woo JANG ,  Yoojin KIM ,  Channoh KIM

IPC: G06F13/16

Abstract: A data transmission method for a convolution operation, and a convolution operation apparatus including a fetcher that includes a loader, at least one sender, a buffer controller, and a reuse buffer. The method includes loading, by the loader, input data of an input feature map according to a loading order, based on input data stored in the reuse buffer, a shape of a kernel to be used for a convolution operation, and two-dimensional (2D) zero-value information of weights of the kernel; storing, by the buffer controller, the loaded input data in the reuse buffer of an address cyclically assigned according to the loading order; and selecting, by each of the at least one sender, input data corresponding to each output data of a convolution operation among the input data stored in the reuse buffer, based on one-dimensional (1D) zero-value information of the weights, and outputting the selected input data.

公开(公告)号：US20200012936A1

公开(公告)日：2020-01-09

申请号：US16249279

申请日：2019-01-16

Applicant: Samsung Electronics Co., Ltd.

Inventor： Junhaeng LEE ,  Hyunsun PARK ,  Joonho SONG

IPC: G06N3/08 ,  G06N3/04

Abstract: A neural network method and apparatus are provided. A processor implemented neural network includes calculating respective individual gradient values for updating a weight of a neural network, calculating a residual gradient value based on an accumulated gradient value obtained by accumulating the individual gradient values and a bit digit representing the weight, tuning the respective individual gradient values to correspond to a bit digit of the residual gradient value, summing the tuned respective individual gradient values, the residual gradient value, and the weight, and updating the weight and the residual gradient value based on a result of the summing to train the neural network.

公开(公告)号：US20230102087A1

公开(公告)日：2023-03-30

申请号：US17993740

申请日：2022-11-23

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Junhaeng LEE ,  Hyunsun PARK ,  Yeongjae CHOI

IPC: G06N3/08 ,  G06N3/063 ,  G06F7/483

Abstract: A processor-implemented neural network method includes calculating individual update values for a weight assigned to a connection relationship between nodes included in a neural network; generating an accumulated update value by adding the individual update values; and training the neural network by updating the weight using the accumulated update value in response to the accumulated update value being equal to or greater than a threshold value, wherein the threshold value is a value of 2n of an n-th bit of the weight, where the n-th bit is a bit of lesser significance than a bit in the weight representing a largest magnitude bit among all bits of the weight

公开(公告)号：US20210064992A1

公开(公告)日：2021-03-04

申请号：US16803342

申请日：2020-02-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Hyunsun PARK ,  Yoojin KIM ,  Hyeongseok YU ,  Sehwan LEE ,  Junwoo JANG

IPC: G06N3/08 ,  G06N3/04

Abstract: A method of processing data includes identifying a sparsity of input data, based on valid information included in the input data, rearranging the input data, based on a form of the sparsity, and generating output data by processing the rearranged input data.

公开(公告)号：US20190340504A1

公开(公告)日：2019-11-07

申请号：US16244644

申请日：2019-01-10

Applicant: Samsung Electronics Co., Ltd.

Inventor： Junhaeng LEE ,  Hyunsun PARK ,  Sehwan LEE ,  Seungwon LEE

IPC: G06N3/08

Abstract: A neural network method and apparatus is provided. A processor-implemented neural network method includes determining, based on a determined number of classes of input data, a precision for a neural network layer outputting an operation result, and processing parameters of the layer according to the determined precision.