公开(公告)号：US20210326762A1

公开(公告)日：2021-10-21

申请号：US17351194

申请日：2021-06-17

Applicant: Beijing Baidu Netcom Science and Technology Co., Ltd.

Inventor： Zhihua Wu ,  Dianhai Yu ,  Xuefeng Yao ,  Wei Tang ,  Xinxuan Wu ,  Mo Cheng ,  Lin Ma ,  Yanjun Ma ,  Tian Wu ,  Haifeng Wang

IPC: G06N20/00

Abstract: The present disclosure discloses an apparatus and method for distributedly training a model, an electronic device, and a computer readable storage medium. The apparatus may include: a distributed reader, a distributed trainer and a distributed parameter server that are mutually independent. A reader in the distributed reader is configured to acquire a training sample, and load the acquired training sample to a corresponding trainer in the distributed trainer; the trainer in the distributed trainer is configured to perform model training based on the loaded training sample to obtain gradient information; and a parameter server in the distributed parameter server is configured to update a parameter of an initial model based on the gradient information of the distributed trainer to obtain a trained target model.