公开(公告)号：US11663201B2

公开(公告)日：2023-05-30

申请号：US16609318

申请日：2018-04-27

Applicant: Google LLC

Inventor： Jyrki Alakuijala ,  Christian Buck ,  Jannis Bulian ,  Massimiliano Ciaramita ,  Wojciech Gajewski ,  Andrea Gesmundo ,  Neil Houlsby ,  Wei Wang

IPC: G06F16/242 ,  G06N3/08 ,  G06N3/047 ,  G06N3/044

CPC classification number: G06F16/242 ,  G06N3/047 ,  G06N3/08 ,  G06N3/044

Abstract: Systems, methods, and computer readable media related to generating query variants for a submitted query. In many implementations, the query variants are generated utilizing a generative model. A generative model is productive, in that it can be utilized to actively generate a variant of a query based on application of tokens of the query to the generative model, and optionally based on application of additional input features to the generative model.

公开(公告)号：US20230281193A1

公开(公告)日：2023-09-07

申请号：US18196913

申请日：2023-05-12

Applicant: GOOGLE LLC

Inventor： Jyrki Alakuijala ,  Christian Buck ,  Jannis Bulian ,  Massimiliano Ciaramita ,  Wojciech Gajewski ,  Andrea Gesmundo ,  Neil Houlsby ,  Wei Wang

IPC: G06F16/242 ,  G06N3/08 ,  G06N3/047

CPC classification number: G06F16/242 ,  G06N3/08 ,  G06N3/047 ,  G06N3/044

Abstract: Systems, methods, and computer readable media related to generating query variants for a submitted query. In many implementations, the query variants are generated utilizing a generative model. A generative model is productive, in that it can be utilized to actively generate a variant of a query based on application of tokens of the query to the generative model, and optionally based on application of additional input features to the generative model.

公开(公告)号：US20220253672A1

公开(公告)日：2022-08-11

申请号：US17666400

申请日：2022-02-07

Applicant: Google LLC

Inventor： Aakanksha Chowdhery ,  Afroz Mohiuddin ,  Henryk Michalewski ,  Jonni Miikka Kanerva ,  Lukasz Mieczyslaw Kaiser ,  Sebastian Dariusz Jaszczur ,  Wojciech Gajewski

IPC: G06N3/04

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing a machine learning task on a network input to generate a network output. In one aspect, one of the systems includes a neural network configured to perform the machine learning task, the neural network including one or more sparse attention layers.