公开(公告)号：US20230185749A1

公开(公告)日：2023-06-15

申请号：US17824814

申请日：2022-05-25

申请人： Alibaba (China) Co., Ltd.

发明人： Liang HAN ,  ChengYuan WU ,  Guoyu ZHU ,  Rong ZHONG ,  Yang JIAO ,  Ye LU ,  Wei WU ,  Yunxiao ZOU ,  Li YIN

IPC分类号： G06F13/40

CPC分类号： G06F13/4022 ,  G06F13/4063 ,  G06F2213/0026

摘要： A system includes a high-bandwidth inter-chip network (ICN) that allows communication between neural network processing units (NPUs) in the system. For example, the ICN allows an NPU to communicate with other NPUs on the same compute node (server) and also with NPUs on other compute nodes (servers). Communication can be at the direct memory access (DMA) command level and at the finer-grained load/store instruction level. The ICN system and the programming model allows NPUs in the system to communicate without using a traditional network (e.g., Ethernet) that uses a relatively narrow and slow Peripheral Component Interconnect Express (PCIe) bus.