Invention Grant
- Patent Title: Mixed-precision processing elements, systems, and methods for computational models
-
Application No.: US15857998Application Date: 2017-12-29
-
Publication No.: US10474430B2Publication Date: 2019-11-12
- Inventor: Abdulkadir Utku Diril , Mikhail Smelyanskiy , Nadav Rotem , Jong Soo Park
- Applicant: Facebook, Inc.
- Applicant Address: US CA Menlo Park
- Assignee: Facebook, Inc.
- Current Assignee: Facebook, Inc.
- Current Assignee Address: US CA Menlo Park
- Agency: FisherBroyles, LLP
- Main IPC: G06F7/544
- IPC: G06F7/544 ; G06F7/523 ; G06N3/08 ; G06N5/02

Abstract:
The disclosed method may include (1) receiving a precision level of each weight associated with each input of a node of a computational model, (2) identifying, for each weight, one of a plurality of multiplier groups, where each multiplier group may include a plurality of hardware multipliers of a corresponding bit width, and where the corresponding bit width of the plurality of hardware multipliers of the one of the plurality of multiplier groups may be sufficient to multiply the weight by the associated input, and (3) multiplying each weight by its associated input using an available hardware multiplier of the one of the plurality of multiplier groups identified for the weight. Various other processing elements, methods, and systems are also disclosed.
Public/Granted literature
- US20190205094A1 MIXED-PRECISION PROCESSING ELEMENTS, SYSTEMS, AND METHODS FOR COMPUTATIONAL MODELS Public/Granted day:2019-07-04
Information query