- 专利标题: DATA PROCESSING METHOD AND RELATED DEVICE
-
申请号: EP23746144.7申请日: 2023-01-17
-
公开(公告)号: EP4462313A1公开(公告)日: 2024-11-13
- 发明人: ZHOU, Pingyi , REN, Xiaozhe , WANG, Yasheng , HE, Bin , MENG, Xinfan , JIANG, Xin
- 申请人: Huawei Technologies Co., Ltd.
- 申请人地址: CN Shenzhen, Guangdong 518129 Huawei Administration Building Bantian Longgang District
- 代理机构: Pfenning, Meinig & Partner mbB
- 优先权: CN202210111721 20220129
- 国际公布: WO2023143262 20230803
- 主分类号: G06N3/08
- IPC分类号: G06N3/08
摘要:
This application relates to the artificial intelligence field, and discloses a data processing method. The method includes: processing target data through a target neural network to obtain a data processing result, where a target header of the target neural network is used to process, through a first transformation matrix, a first vector corresponding to first subdata, and process, through a second transformation matrix, a second vector corresponding to the first subdata, where the first vector corresponds to position information of the first subdata in the target data, and the second vector corresponds to semantic information of the first subdata. In this application, a matrix size of a transformation matrix corresponding to a position vector is set to be less than a size of a matrix corresponding to a semantic vector. To be specific, a size of the first transformation matrix is less than a size of the second transformation matrix. This can reduce a size of a transformation matrix used for calculating a correlation between position information, to reduce computing resource overheads of a model during inference or training.
信息查询