Killing asymmetric resistive processing units for neural network training

    公开(公告)号:US09715656B1

    公开(公告)日:2017-07-25

    申请号:US15262582

    申请日:2016-09-12

    Inventor: Tayfun Gokmen

    CPC classification number: G06N3/08 G06N3/063 G06N3/084

    Abstract: Technical solutions are described for improving efficiency of training a resistive processing unit (RPU) array using a neural network training methodology. An example method includes reducing asymmetric RPUs from the RPU array by determining an asymmetric value of an RPU from the RPU array, and burning the RPU in response to the asymmetry value being above a predetermined threshold. The RPU can be burned by causing an electric voltage across the RPU to be above a predetermined limit. The method further includes initiating the training methodology for the RPU array after the asymmetric RPUs from the RPU array are reduced.

    Auto weight scaling for RPUs
    35.
    发明授权

    公开(公告)号:US11556770B2

    公开(公告)日:2023-01-17

    申请号:US16427598

    申请日:2019-05-31

    Abstract: Techniques for auto weight scaling a bounded weight range of RPU devices with the size of the array during ANN training are provided. In one aspect, a method of ANN training includes: initializing weight values winit in the array to a random value, wherein the array represents a weight matrix W with m rows and n columns; calculating a scaling factor β based on a size of the weight matrix W; providing digital inputs x to the array; dividing the digital inputs x by a noise and bound management factor α to obtain adjusted digital inputs x′; performing a matrix-vector multiplication of the adjusted digital inputs x′ with the array to obtain digital outputs y′; multiplying the digital outputs y′ by the noise and bound management factor α; and multiplying the digital outputs y′ by the scaling factor β to provide digital outputs y of the array.

Patent Agency Ranking