公开(公告)号：EP4462313A1

公开(公告)日：2024-11-13

申请号：EP23746144.7

申请日：2023-01-17

申请人： Huawei Technologies Co., Ltd.

发明人： ZHOU, Pingyi ,  REN, Xiaozhe ,  WANG, Yasheng ,  HE, Bin ,  MENG, Xinfan ,  JIANG, Xin

IPC分类号： G06N3/08

摘要： This application relates to the artificial intelligence field, and discloses a data processing method. The method includes: processing target data through a target neural network to obtain a data processing result, where a target header of the target neural network is used to process, through a first transformation matrix, a first vector corresponding to first subdata, and process, through a second transformation matrix, a second vector corresponding to the first subdata, where the first vector corresponds to position information of the first subdata in the target data, and the second vector corresponds to semantic information of the first subdata. In this application, a matrix size of a transformation matrix corresponding to a position vector is set to be less than a size of a matrix corresponding to a semantic vector. To be specific, a size of the first transformation matrix is less than a size of the second transformation matrix. This can reduce a size of a transformation matrix used for calculating a correlation between position information, to reduce computing resource overheads of a model during inference or training.