公开(公告)号：US20210390410A1

公开(公告)日：2021-12-16

申请号：US17347416

申请日：2021-06-14

Applicant: Google LLC

Inventor： Ashish Teku Vaswani ,  Prajit Ramachandran ,  Aravind Srinivas Lakshminarayanan ,  Blake Alan Hechtman ,  Niki J. Parmar

IPC: G06N3/08 ,  G06K9/62 ,  G06K9/72 ,  G06K9/00

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing images using a computer vision neural network that has one or more local self-attention layers. Each local self-attention layer is configured to apply or more local self-attention mechanisms to the layer input to the local self-attention layer.