-
公开(公告)号:US20230403232A1
公开(公告)日:2023-12-14
申请号:US18356475
申请日:2023-07-21
Applicant: Huawei Technologies Co., Ltd.
Inventor: Qihang Duan
Abstract: A system includes a plurality of nodes, and a plurality of accelerators in each node are connected to each other through a first communication link. A plurality of communication planes is constructed between accelerators in the plurality of nodes. Each communication plane includes one accelerator in each node. A first accelerator in a first node obtains first data sent by another accelerator in the first node, and the first data includes data to be sent by the other accelerator in the first node to a second accelerator in a second node. Then, the first accelerator sends the first data to the second accelerator through the second communication link.
-
公开(公告)号:US20240296327A1
公开(公告)日:2024-09-05
申请号:US18646489
申请日:2024-04-25
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Shengyu Shen , Zeshan Chang , Jingyan Wang , Guangcan Mi , Xin Liu , Qihang Duan , Wenkai Ling , Weibin Lin
IPC: G06N3/08
CPC classification number: G06N3/08
Abstract: This application provides a model training system and method. The system includes a first group, where the first group includes an MEMS and S×C processors, S is a quantity of nodes in the first group, C is a quantity of processors in one node, and both S and C are positive integers, the MEMS, configured to construct an optical transmission channel between any two of the S nodes, and the S×C processors, configured to jointly train a model. In one iteration of joint model training, the S×C processors are configured to run model training in respective processors, to obtain respective corresponding data. At least two of the S×C processors transmit target data through the optical transmission channel. A processor that receives the target data may be configured to adjust a parameter for model training in the processor based on the target data.
-
公开(公告)号:US12225083B2
公开(公告)日:2025-02-11
申请号:US18117242
申请日:2023-03-03
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Qihang Duan
IPC: H04L41/12 , H04L47/70 , H04L67/1097 , G06F15/173 , H04L1/00 , H04L45/24 , H04L47/41 , H04L49/15
Abstract: This application provides a data processing method. One example method includes: A switching node, that is, a first top node, that is in a first group and that is configured to communicate with a second top node in a second group receives first data sent by a child node; then the first top node receives second data sent by the second top node; and then the first top node aggregates the first data and the second data, to obtain third data.
-
-