Continuous parametrizations of neural network layer weights

    公开(公告)号:US12093830B2

    公开(公告)日:2024-09-17

    申请号:US16976805

    申请日:2019-07-23

    Applicant: Google LLC

    CPC classification number: G06N3/084 G06F18/213 G06N3/048 G06N3/08

    Abstract: Methods, systems, and apparatus for more efficiently and accurately generating neural network outputs, for instance, for use in classifying image or audio data. In one aspect, a method includes processing a network input using a neural network including multiple neural network layers to generate a network output. One or more of the neural network layers is a conditional neural network layer. Processing a layer input using a conditional neural network layer to generate a layer output includes obtaining values of one or more decision parameters of the conditional neural network layer. The neural network processes the layer input and the decision parameters of the conditional neural network layer to determine values of one or more latent parameters of the conditional neural network layer from a continuous set of possible latent parameter values. The values of the latent parameters specify the values of the conditional layer weights.

Patent Agency Ranking