Invention Grant
- Patent Title: Computing system for performing efficient machine learning processing
-
Application No.: US16357438Application Date: 2019-03-19
-
Publication No.: US11797841B2Publication Date: 2023-10-24
- Inventor: Shinichi Ouchi , Hiroshi Fuketa
- Applicant: NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
- Applicant Address: JP Tokyo
- Assignee: NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
- Current Assignee: NATIONAL INSTITUTE OF ADVANCED INDUSTRIAL SCIENCE AND TECHNOLOGY
- Current Assignee Address: JP Tokyo
- Agency: Studebaker & Brackett PC
- Priority: JP 18052090 2018.03.20
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06F7/483

Abstract:
A computing system capable of obtaining a calculation speed exceeding that of 16-bit floating point processing while maintaining accuracy of calculation results. A computing system includes a parameter server, a communication path and a worker. The parameter server has a storage unit that stores a parameter value of a training target model, and a first conversion unit that converts the parameter value into data represented by a floating point number with 10 bits or less. The communication path transmits the data transmitted and received between the parameter server and the worker. The worker has a processing unit that computes a product and a sum of the data. The parameter server further has a second conversion unit that converts the data with 10 bits or less received from the worker into an updating difference, and an updating unit that updates the parameter value on the basis of the updating difference.
Public/Granted literature
- US20190294964A1 COMPUTING SYSTEM Public/Granted day:2019-09-26
Information query