公开(公告)号：US20240037378A1

公开(公告)日：2024-02-01

申请号：US18255391

申请日：2020-12-24

Applicant: Intel Corporation

Inventor： Guokai Ma ,  Jiong Gong ,  Dhiraj Kalamkar ,  Rachitha Prem Seelin ,  Hongzhen Liu ,  Akshay Jain ,  Liangang Zhang

IPC: G06N3/063 ,  G06N3/084

CPC classification number: G06N3/063 ,  G06N3/084

Abstract: Systems, apparatuses and methods may provide for technology that identifies an embedding table associated with a neural network. The neural network is associated with a plurality of compute nodes. The technology further identifies a number of entries of the embedding table, and determines whether to process gradients associated with the embedding table as dense gradients or sparse gradients based on the number of entries.