公开(公告)号：US20230306257A1

公开(公告)日：2023-09-28

申请号：US17866194

申请日：2022-07-15

申请人： Alibaba (China) Co., Ltd.

发明人： Fei SUN ,  Minghai QIN ,  Haoran LI ,  Guocai ZHU ,  Yuan GAO ,  Guyue HUANG ,  Yawen ZHANG

IPC分类号： G06N3/08 ,  G06F7/78 ,  G06F7/523

CPC分类号： G06N3/08 ,  G06F7/78 ,  G06F7/523

摘要： Neural network (NN) model training techniques can include computing activations in a forward pass using a sparse weight matrix that is transpose invariant. The neural network (NN) model training techniques can further include computing activation gradients and weight gradients in a backward pass using the sparse weight matrix.