ULTRA PIPELINED ACCELERATOR FOR MACHINE LEARNING INFERENCE

    公开(公告)号:US20210124588A1

    公开(公告)日:2021-04-29

    申请号:US16838971

    申请日:2020-04-02

    Abstract: A method of pipelining inference of a neural network, which includes an i-th layer (i being an integer greater than zero), an (i+1)-th layer, and an (i+2)-th layer, includes processing a first set of i-th values of the i-th layer to generate (i+1)-th values for the (i+1)-th layer, determining a quantity of the (i+1)-th values as being sufficient for processing, and in response to the determining, processing the (i+1)-th values to generate an output value for the (i+2)-th layer while concurrently processing a second set of i-th values of the i-th layer.

Patent Agency Ranking