公开(公告)号：US20230196205A1

公开(公告)日：2023-06-22

申请号：US18085140

申请日：2022-12-20

Applicant: Electronics and Telecommunications Research Institute

Inventor： An Seok LEE ,  Yong Jin KWON ,  Heesoo LEE ,  Yo Seb JEON ,  Jae Won YUN

IPC: G06N20/00 ,  G06F17/18

CPC classification number: G06N20/00 ,  G06F17/18

Abstract: A learning method of distributed artificial intelligence is disclosed. The method is comprising: updating, by the local device, parameters of a corresponding local model by training the local model based on a corresponding local dataset; generating, by the local device, compressed gradient information by compressing gradients of the parameter of the local model; transmitting, by the local device, the compressed gradient information to a parameter server; reconstructing, by a parameter server, gradients of the parameters of the local model based on the compressed gradient information received from the local device; and updating, by the parameter server, parameters of a global model based on the reconstructed gradients of the parameters of the local model.