公开(公告)号：US20230121404A1

公开(公告)日：2023-04-20

申请号：US17798046

申请日：2021-02-08

Applicant: Google LLC

Inventor： Hanxiao Liu ,  Quoc V. Le ,  Andrew Brock ,  Karen Simonyan

IPC: G06N3/08 ,  G06N3/04

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for searching for an architecture for an activation-normalization layer to be included in a neural network to replace a set of layers that receive a layer input comprising a plurality of values, apply one or more normalization operations to the values in the layer input to generate a normalized layer input, and apply an element-wise activation function to the normalized layer input to generate a layer output.