EFFICIENT SIMULTANEOUS INFERENCE COMPUTATION FOR MULTIPLE NEURAL NETWORKS

    公开(公告)号:US20210287087A1

    公开(公告)日:2021-09-16

    申请号:US17192250

    申请日:2021-03-04

    Abstract: A method for the inference computation of a plurality of neural networks on a hardware platform. Each of the neural networks comprise a plurality of neurons, which respectively aggregate inputs into a network input using a transfer function characterized by weights and process this network input into an activation using an activation function. The method includes: identifying at least one unit, which comprises one or multiple transfer functions and/or complete neurons and exists in at least two of the networks in the same form or in a form that is similar according to a predefined criterion; performing a single inference computation for the unit on the hardware platform so that the unit provides a set of outputs; processing this set of outputs in the respective networks as an output of the unit. A method for the simultaneous execution of multiple applications is also provided.

Patent Agency Ranking