-
公开(公告)号:US10510021B1
公开(公告)日:2019-12-17
申请号:US16434627
申请日:2019-06-07
Applicant: Google LLC
Inventor: Satyen Chandrakant Kale , Daniel Holtmann-Rice , Sanjiv Kumar , Enxu Yan , Xinnan Yu
Abstract: Systems and methods for evaluating a loss function or a gradient of the loss function. In one example embodiment, a computer-implemented method includes partitioning a weight matrix into a plurality of blocks. The method includes identifying a first set of labels for each of the plurality of blocks with a score greater than a first threshold value. The method includes constructing a sparse approximation of a scoring vector for each of the plurality of blocks based on the first set of labels. The method includes determining a correction value for each sparse approximation of the scoring vector. The method includes determining an approximation of a loss or a gradient of a loss associated with the scoring function based on each sparse approximation of the scoring vector and the correction value associated with the sparse approximation of the scoring vector.
-
2.
公开(公告)号:US20190378037A1
公开(公告)日:2019-12-12
申请号:US16434627
申请日:2019-06-07
Applicant: Google LLC
Inventor: Satyen Chandrakant Kale , Daniel Holtmann-Rice , Sanjiv Kumar , Enxu Yan , Xinnan Yu
Abstract: Systems and methods for evaluating a loss function or a gradient of the loss function. In one example embodiment, a computer-implemented method includes partitioning a weight matrix into a plurality of blocks. The method includes identifying a first set of labels for each of the plurality of blocks with a score greater than a first threshold value. The method includes constructing a sparse approximation of a scoring vector for each of the plurality of blocks based on the first set of labels. The method includes determining a correction value for each sparse approximation of the scoring vector. The method includes determining an approximation of a loss or a gradient of a loss associated with the scoring function based on each sparse approximation of the scoring vector and the correction value associated with the sparse approximation of the scoring vector.
-