公开(公告)号：US20230120410A1

公开(公告)日：2023-04-20

申请号：US18082357

申请日：2022-12-15

Applicant: Google LLC

Inventor： Jakob D. Uszkoreit ,  Mitchell Thomas Stern ,  Jamie Ryan Kiros ,  William Chan

IPC: G06F40/44 ,  G06N3/08 ,  G06N5/04 ,  G06N3/044

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating network outputs using insertion operations.

公开(公告)号：US11556721B2

公开(公告)日：2023-01-17

申请号：US16988551

申请日：2020-08-07

Applicant: Google LLC

Inventor： Jakob D. Uszkoreit ,  Mitchell Thomas Stern ,  Jamie Ryan Kiros ,  William Chan

IPC: G06F40/44 ,  G06N3/04 ,  G06N3/08 ,  G06N5/04

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating network outputs using insertion operations.

公开(公告)号：US20200234011A1

公开(公告)日：2020-07-23

申请号：US16751167

申请日：2020-01-23

Applicant: Google LLC

Inventor： Jakob D. Uszkoreit ,  Mitchell Thomas Stern ,  Jamie Ryan Kiros ,  William Chan

IPC: G06F40/44 ,  G06N5/04 ,  G06N3/04 ,  G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating network outputs using insertion operations.

公开(公告)号：US20190354812A1

公开(公告)日：2019-11-21

申请号：US16417190

申请日：2019-05-20

Applicant: Google LLC

Inventor： Noam M. Shazeer ,  Jakob D. Uszkoreit ,  Mitchell Thomas Stern

IPC: G06K9/62 ,  G06N7/00 ,  G06N20/00

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing parallel generation of output from an autoregressive sequence to sequence model. In one aspect, a blockwise parallel decoding method takes advantage of the fact that some architectures can score sequences in sublinear time. By generating predictions for multiple time steps at once then backing off to a longest prefix validated by the scoring model, the methods can substantially improve the speed of greedy decoding without compromising performance.