公开(公告)号：US10699191B2

公开(公告)日：2020-06-30

申请号：US15349901

申请日：2016-11-11

Applicant: Google LLC

Inventor： Ian Goodfellow ,  Tianqi Chen ,  Jonathan Shlens

IPC: G06N3/08 ,  G06N3/04

Abstract: This specification describes methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a larger neural network from a smaller neural network. One of the described methods includes obtaining data specifying an original neural network and generating a larger neural network from the original neural network The larger neural network has a larger neural network structure than the original neural network structure. The values of the parameters of the original neural network units and the additional neural network units are initialized so that the larger neural network generates the same outputs from the same inputs as the original neural network and the larger neural network is trained to determine trained values of the parameters of the original neural network units and the additional neural network units from the initialized values.

公开(公告)号：US11790233B2

公开(公告)日：2023-10-17

申请号：US16915502

申请日：2020-06-29

Applicant: Google LLC

Inventor： Ian Goodfellow ,  Tianqi Chen ,  Jonathon Shlens

IPC: G06N3/08 ,  G06N3/04 ,  G06N3/082 ,  G06N3/045

CPC classification number: G06N3/082 ,  G06N3/04 ,  G06N3/045

Abstract: The specification describes methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a larger neural network from a smaller neural network. One of the described methods includes obtaining data specifying an original neural network and generating a larger neural network from the original neural network. The larger neural network has a larger neural network structure than the original neural network structure. The values of the parameters of the original neural network units and the additional neural network units are initialized so that the larger neural network generates the same outputs from the same inputs as the original neural network, and the larger neural network is trained to determine trained values of the parameters of the original neural network units and the additional neural network units from the initialized values.