公开(公告)号：US20220108212A1

公开(公告)日：2022-04-07

申请号：US17308033

申请日：2021-05-04

Applicant: Apple Inc.

Inventor： Shuangfei ZHAI ,  Walter A. TALBOTT ,  Nitish SRIVASTAVA ,  Chen HUANG ,  Hanlin GOH ,  Joshua M. SUSSKIND

IPC: G06N20/00 ,  G06N5/04 ,  G06F17/16 ,  G06F40/58 ,  G06T3/40

Abstract: Attention-free transformers are disclosed. Various implementations of attention-free transformers include a gating and pooling operation that allows the attention-free transformers to provide comparable or better results to those of a standard attention-based transformer, with improved efficiency and reduced computational complexity with respect to space and time.

公开(公告)号：US20210099731A1

公开(公告)日：2021-04-01

申请号：US16835724

申请日：2020-03-31

Applicant: Apple Inc.

Inventor： Shuangfei ZHAI ,  Joshua M. SUSSKIND

IPC: H04N19/625 ,  G06N20/00

Abstract: Techniques for coding sets of images with neural networks include transforming a first image of a set of images into coefficients with an encoder neural network, encoding a group of the coefficients as an integer patch index into coding table of table entries each having vectors of coefficients, and storing a collection of patch indices as a first coded image. The encoder neural network may be configured with encoder weights determined by jointly with corresponding decoder weights of a decoder neural network on the set of images.