-
公开(公告)号:US20200167125A1
公开(公告)日:2020-05-28
申请号:US16200325
申请日:2018-11-26
Applicant: NVIDIA Corporation
Inventor: Alex Fit-Florea , Boris Ginsburg , Pooya Davoodi , Amir Gholaminejad
Abstract: A method, computer readable medium, and system are disclosed for rounding floating point values. Dynamic directional rounding is a rounding technique for floating point operations. A floating point operation (addition, subtraction, multiplication, etc.) is performed on an operand to compute a floating point result. A sign (positive or negative) of the operand is identified. In one embodiment, the sign determines a direction in which the floating point result is rounded (towards negative or positive infinity). When used for updating parameters of a neural network during backpropagation, dynamic directional rounding ensures that rounding is performed in the direction of the gradient.
-
公开(公告)号:US20210232366A1
公开(公告)日:2021-07-29
申请号:US17163855
申请日:2021-02-01
Applicant: NVIDIA Corporation
Inventor: Alex Fit-Florea , Boris Ginsburg , Pooya Davoodi , Amir Gholaminejad
Abstract: A method, computer readable medium, and system are disclosed for rounding floating point values. Dynamic directional rounding is a rounding technique for floating point operations. A floating point operation (addition, subtraction, multiplication, etc.) is performed on an operand to compute a floating point result. A sign (positive or negative) of the operand is identified. In one embodiment, the sign determines a direction in which the floating point result is rounded (towards negative or positive infinity). When used for updating parameters of a neural network during backpropagation, dynamic directional rounding ensures that rounding is performed in the direction of the gradient.
-
公开(公告)号:US10908878B2
公开(公告)日:2021-02-02
申请号:US16200325
申请日:2018-11-26
Applicant: NVIDIA Corporation
Inventor: Alex Fit-Florea , Boris Ginsburg , Pooya Davoodi , Amir Gholaminejad
Abstract: A method, computer readable medium, and system are disclosed for rounding floating point values. Dynamic directional rounding is a rounding technique for floating point operations. A floating point operation (addition, subtraction, multiplication, etc.) is performed on an operand to compute a floating point result. A sign (positive or negative) of the operand is identified. In one embodiment, the sign determines a direction in which the floating point result is rounded (towards negative or positive infinity). When used for updating parameters of a neural network during backpropagation, dynamic directional rounding ensures that rounding is performed in the direction of the gradient.
-
-