公开(公告)号：US12271791B2

公开(公告)日：2025-04-08

申请号：US17308033

申请日：2021-05-04

Applicant: Apple Inc.

Inventor： Shuangfei Zhai ,  Walter A. Talbott ,  Nitish Srivastava ,  Chen Huang ,  Hanlin Goh ,  Joshua M. Susskind

IPC: G06N20/00 ,  G06F17/16 ,  G06F40/58 ,  G06N5/04 ,  G06T3/4053

Abstract: Attention-free transformers are disclosed. Various implementations of attention-free transformers include a gating and pooling operation that allows the attention-free transformers to provide comparable or better results to those of a standard attention-based transformer, with improved efficiency and reduced computational complexity with respect to space and time.

公开(公告)号：US11496769B2

公开(公告)日：2022-11-08

申请号：US16835724

申请日：2020-03-31

Applicant: Apple Inc.

Inventor： Shuangfei Zhai ,  Joshua M. Susskind

IPC: H04N19/00 ,  H04N19/625 ,  G06N20/00

Abstract: Techniques for coding sets of images with neural networks include transforming a first image of a set of images into coefficients with an encoder neural network, encoding a group of the coefficients as an integer patch index into coding table of table entries each having vectors of coefficients, and storing a collection of patch indices as a first coded image. The encoder neural network may be configured with encoder weights determined by jointly with corresponding decoder weights of a decoder neural network on the set of images.