公开(公告)号：US11842264B2

公开(公告)日：2023-12-12

申请号：US16759993

申请日：2018-11-30

Applicant: DeepMind Technologies Limited

Inventor： Agnieszka Grabska-Barwinska ,  Peter Toth ,  Christopher Mattern ,  Avishkar Bhoopchand ,  Tor Lattimore ,  Joel William Veness

IPC: G06N3/063 ,  G06N3/047 ,  G06N3/048 ,  G06N7/01

CPC classification number: G06N3/063 ,  G06N3/047 ,  G06N3/048 ,  G06N7/01

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a neural network system comprising one or more gated linear networks. A system includes: one or more gated linear networks, wherein each gated linear network corresponds to a respective data value in an output data sample and is configured to generate a network probability output that defines a probability distribution over possible values for the corresponding data value, wherein each gated linear network comprises a plurality of layers, wherein the plurality of layers comprises a plurality of gated linear layers, wherein each gated linear layer has one or more nodes, and wherein each node is configured to: receive a plurality of inputs, receive side information for the node; combine the plurality of inputs according to a set of weights defined by the side information, and generate and output a node probability output for the corresponding data value.

公开(公告)号：US20240202511A1

公开(公告)日：2024-06-20

申请号：US18536127

申请日：2023-12-11

Applicant: DeepMind Technologies Limited

Inventor： Agnieszka Grabska-Barwinska ,  Peter Toth ,  Christopher Mattern ,  Avishkar Bhoopchand ,  Tor Lattimore ,  Joel William Veness

IPC: G06N3/063 ,  G06N3/047 ,  G06N3/048 ,  G06N7/01

CPC classification number: G06N3/063 ,  G06N3/047 ,  G06N3/048 ,  G06N7/01

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a neural network system comprising one or more gated linear networks. A system includes: one or more gated linear networks, wherein each gated linear network corresponds to a respective data value in an output data sample and is configured to generate a network probability output that defines a probability distribution over possible values for the corresponding data value, wherein each gated linear network comprises a plurality of layers, wherein the plurality of layers comprises a plurality of gated linear layers, wherein each gated linear layer has one or more nodes, and wherein each node is configured to: receive a plurality of inputs, receive side information for the node; combine the plurality of inputs according to a set of weights defined by the side information, and generate and output a node probability output for the corresponding data value.

公开(公告)号：US20200349418A1

公开(公告)日：2020-11-05

申请号：US16759993

申请日：2018-11-30

Applicant: DeepMind Technologies Limited

Inventor： Agnieszka Grabska-Barwinska ,  Peter Toth ,  Christopher Mattern ,  Avishkar Bhoopchand ,  Tor Lattimore ,  Joel William Veness

IPC: G06N3/063 ,  G06N3/04 ,  G06N7/00

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for a neural network system comprising one or more gated linear networks. A system includes: one or more gated linear networks, wherein each gated linear network corresponds to a respective data value in an output data sample and is configured to generate a network probability output that defines a probability distribution over possible values for the corresponding data value, wherein each gated linear network comprises a plurality of layers, wherein the plurality of layers comprises a plurality of gated linear layers, wherein each gated linear layer has one or more nodes, and wherein each node is configured to: receive a plurality of inputs, receive side information for the node; combine the plurality of inputs according to a set of weights defined by the side information, and generate and output a node probability output for the corresponding data value.