Invention Grant
- Patent Title: System and method for fault-tolerant parallel learning over non-iid data
-
Application No.: US15296560Application Date: 2016-10-18
-
Publication No.: US10291485B2Publication Date: 2019-05-14
- Inventor: Asim Kadav , Renqiang Min , Erik Kruus , Cun Mu
- Applicant: NEC Laboratories America, Inc.
- Applicant Address: JP Tokyo
- Assignee: NEC Corporation
- Current Assignee: NEC Corporation
- Current Assignee Address: JP Tokyo
- Agent Joseph Kolodka
- Main IPC: H04L12/00
- IPC: H04L12/00 ; H04L12/24 ; G06N20/00

Abstract:
A network device, system, and method are provided. The network device includes a processor. The processor is configured to store a local estimate and a dual variable maintaining an accumulated subgradient for the network device. The processor is further configured to collect values of the dual variable of neighboring network devices. The processor is also configured to form a convex combination with equal weight from the collected dual variable of neighboring network devices. The processor is additionally configured to add a most recent local subgradient for the network device, scaled by a scaling factor, to the convex combination to obtain an updated dual variable. The processor is further configured to update the local estimate by projecting the updated dual variable to a primal space.
Public/Granted literature
- US20170111234A1 SYSTEM AND METHOD FOR FAULT-TOLERANT PARALLEL LEARNING OVER NON-IID DATA Public/Granted day:2017-04-20
Information query