METHOD AND APPARATUS WITH SELF-ATTENTION-BASED IMAGE RECOGNITION

    公开(公告)号:US20230154171A1

    公开(公告)日:2023-05-18

    申请号:US17720681

    申请日:2022-04-14

    CPC classification number: G06V10/82 G06N3/08 G06V10/40

    Abstract: A method with self-attention includes: obtaining a three-dimensional (3D) feature map; generating 3D query data and 3D key data by performing a convolution operation based on the 3D feature map; generating two-dimensional (2D) vertical data based on a vertical projection of the 3D query data and the 3D key data; generating 2D horizontal data based on a horizontal projection of the 3D query data and the 3D key data; determining an intermediate attention result through a multiplication based on the 2D vertical data and the 2D horizontal data; and determining a final attention result through a multiplication based on the intermediate attention result and the 3D feature map.

    METHOD AND APPARATUS FOR PROCESSING CONVOLUTION OPERATION ON LAYER IN NEURAL NETWORK

    公开(公告)号:US20210279568A1

    公开(公告)日:2021-09-09

    申请号:US17015122

    申请日:2020-09-09

    Abstract: Disclosed are methods and apparatuses for processing a convolution operation on a layer in a neural network. The method includes extracting a first target feature vector from a target feature map, extracting a first weight vector matched with the first target feature vector from a first-type weight element, based on matching relationships for depth-wise convolution operations between target feature vectors of the target feature map and weight vectors of the first-type weight element, generating a first intermediate feature vector by performing multiplication between the first target feature vector and the first weight vector, generating a first hidden feature vector by accumulating the first intermediate feature vector and a second intermediate feature vector generated based on a second target feature vector, and generating a first output feature vector of an output feature map based on a point-wise convolution operation between the first hidden feature vector and a second-type weight element.

    NEURAL NETWORK METHOD AND APPARATUS

    公开(公告)号:US20210049474A1

    公开(公告)日:2021-02-18

    申请号:US16856112

    申请日:2020-04-23

    Abstract: A processor-implemented data processing method and apparatus for a neural network is provided. The data processing method includes generating cumulative data by accumulating results of multiplication operations between at least a portion of input elements in an input plane and at least a portion of weight elements in a weight plane, and generating an output plane corresponding to an output channel among output planes of an output feature map respectively corresponding to output channels based on the generated cumulative data.

Patent Agency Ranking