Apparatus and method of performing matrix multiplication operation of neural network

    公开(公告)号:US11899744B2

    公开(公告)日:2024-02-13

    申请号:US16851361

    申请日:2020-04-17

    CPC classification number: G06F17/16 G06F18/213 G06N3/08

    Abstract: A neural network apparatus for performing a matrix multiplication operation includes a memory having at least one program stored therein and a processor to perform one or more operations by executing the at least one program. The processor can determine whether to divide an initial weight in one of a column direction and a row direction according to whether a reshape operation and a transpose operation are performed before or after a matrix multiplication operation and generate division weights by dividing the initial weight by a head count in the determined direction. Also, the processor can generate intermediate feature maps by performing a matrix multiplication operation between the input feature map and the division weights and generate a final feature map based on the intermediate feature maps.

    Neural network method and apparatus

    公开(公告)号:US11681915B2

    公开(公告)日:2023-06-20

    申请号:US16897461

    申请日:2020-06-10

    CPC classification number: G06N3/08 G06N20/10

    Abstract: A processor-implemented method of performing a convolution operation is provided. The method includes obtaining input feature map data and kernel data, determine the kernel data based on a number of input channels of the input feature map, a number of output channels of an output feature map, and a number of groups of the input feature map data and a number of groups of the kernel data related to the convolution operation, and performing the convolution operation based on the input feature map data and the determined kernel data.

    Method and system with neural network model updating

    公开(公告)号:US11681913B2

    公开(公告)日:2023-06-20

    申请号:US16786006

    申请日:2020-02-10

    Inventor: Songyi Han

    CPC classification number: G06N3/08 G06N3/045

    Abstract: A method of updating a neural network model by a terminal device, includes training a local model using a local data set collected by a terminal device to generate a trained local model; receiving, from a server, an independent identically distributed (i.i.d.) global data set, the i.i.d. global data set being a data set sampled for each class in a plurality of predefined classes; implementing the trained local model by inputting the i.i.d. global data set and transmitting final inference results of the implemented trained local model to the server; and receiving, from the server, a global model updated based on the final inference results of the inference.

    Neural network method and apparatus

    公开(公告)号:US12026617B2

    公开(公告)日:2024-07-02

    申请号:US18144009

    申请日:2023-05-05

    CPC classification number: G06N3/08 G06N20/10

    Abstract: A processor-implemented method of performing a convolution operation is provided. The method includes obtaining input feature map data and kernel data, determine the kernel data based on a number of input channels of the input feature map, a number of output channels of an output feature map, and a number of groups of the input feature map data and a number of groups of the kernel data related to the convolution operation, and performing the convolution operation based on the input feature map data and the determined kernel data.

Patent Agency Ranking