METHODS AND APPARATUS FOR LOW PRECISION TRAINING OF A MACHINE LEARNING MODEL

    公开(公告)号:US20200226454A1

    公开(公告)日:2020-07-16

    申请号:US16832830

    申请日:2020-03-27

    申请人: Intel Corporation

    摘要: Methods, apparatus, systems and articles of manufacture for low precision training of a machine learning model are disclosed. An example apparatus includes a low precision converter to calculate an average magnitude of weighting values included in a tensor, the weighting values represented in a high precision format, the low precision converter to calculate a maximal magnitude of the weighting values included in the tensor, determine a squeeze factor and a shift factor based on the average magnitude and the maximal magnitude, and convert the weighting values from the high precision format into a low precision format based on the squeeze factor and the shift factor. A model parameter memory is to store the tensor as part of a machine learning model, the tensor including the weighting values represented in the low precision format, the shift factor, and squeeze factor. A model executor is to execute the machine learning model.