公开(公告)号：US20220156553A1

公开(公告)日：2022-05-19

申请号：US17589542

申请日：2022-01-31

Applicant: Google LLC

Inventor： Joshua Timothy Ainslie ,  Santiago Ontañón ,  Philip Pham ,  Manzil Zaheer ,  Guru Guruganesh ,  Kumar Avinava Dubey ,  Amr Ahmed

IPC: G06N3/04 ,  G06N20/00 ,  G06N3/063 ,  G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing network inputs using an attention neural network that has one or more sparse attention sub-layers. Each sparse attention sub-layer is configured to apply a sparse attention mechanism that attends differently for input positions that are in a first proper subset of the input positions in the input to the sub-layer than for positions that are not in the first proper subset.

公开(公告)号：US20210383191A1

公开(公告)日：2021-12-09

申请号：US17341193

申请日：2021-06-07

Applicant: Google LLC

Inventor： Joshua Timothy Ainslie ,  Santiago Ontañón ,  Philip Pham ,  Manzil Zaheer ,  Guru Guruganesh ,  Kumar Avinava Dubey ,  Amr Ahmed

IPC: G06N3/04 ,  G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing network inputs using an attention neural network that has one or more sparse attention sub-layers. Each sparse attention sub-layer is configured to apply a sparse attention mechanism that attends differently for input positions that are in a first proper subset of the input positions in the input to the sub-layer than for positions that are not in the first proper subset.

公开(公告)号：US20250124264A1

公开(公告)日：2025-04-17

申请号：US18826393

申请日：2024-09-06

Applicant: Google LLC

Inventor： David M. Wang ,  Gaurav Gupta ,  Gokhan Mergen ,  Baixu Chen ,  Kumar Avinava Dubey ,  Amr Ahmed

IPC: G06N3/0475 ,  G06F40/166 ,  G06F40/284 ,  G06F40/30 ,  G06F40/40 ,  G06N3/096

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating descriptions of digital components. In one aspect, a method includes receiving data indicating a query received from a client device of a user. An initial digital component is obtained. Search history data that includes a set of related past queries received from the user is obtained. Updated text related to the first resource is generated by conditioning a language model with one or more contextual inputs that cause the language model to generate one or more outputs that include the updated text, the one or more contextual inputs characterizing one or more of the first query, data related to the initial digital component, the sequence of related past queries, or one or more tasks to be performed by the language model. An updated digital component that depicts the updated text is generated and provided.

公开(公告)号：US20220335274A1

公开(公告)日：2022-10-20

申请号：US17721292

申请日：2022-04-14

Applicant: Google LLC

Inventor： Ankit Singh Rawat ,  Manzil Zaheer ,  Aditya Krishna Menon ,  Sanjiv Kumar ,  Amr Ahmed

IPC: G06N3/04 ,  G06K9/62

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for multi-stage computationally-efficient inference using a first and second neural network.

公开(公告)号：US11238332B2

公开(公告)日：2022-02-01

申请号：US17341193

申请日：2021-06-07

Applicant: Google LLC

Inventor： Joshua Timothy Ainslie ,  Santiago Ontañón ,  Philip Pham ,  Manzil Zaheer ,  Guru Guruganesh ,  Kumar Avinava Dubey ,  Amr Ahmed

IPC: G06N3/04 ,  G06N3/08 ,  G06N3/063 ,  G06N20/00

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing network inputs using an attention neural network that has one or more sparse attention sub-layers. Each sparse attention sub-layer is configured to apply a sparse attention mechanism that attends differently for input positions that are in a first proper subset of the input positions in the input to the sub-layer than for positions that are not in the first proper subset.

公开(公告)号：US20180113919A1

公开(公告)日：2018-04-26

申请号：US15792173

申请日：2017-10-24

Applicant: GOOGLE LLC

Inventor： Ritendra Datta ,  Amr Ahmed ,  Chao-Yuan Wu ,  Gowtham Ramani Kumar

IPC: G06F17/30 ,  G06N3/02 ,  G06Q30/06

CPC classification number: G06F16/248 ,  G06F16/2428 ,  G06F16/903 ,  G06F16/9535 ,  G06N3/02 ,  G06N3/0445 ,  G06Q30/0625

Abstract: Rendering graphical user interfaces display query results based on latent intent of users comprises a query network system. The query server stores data for each result of a group of search results, the product data comprising one or more items of metadata that are usable by the one or more computing devices and are not presented with the results for display to a user computing device. The server correlates items of metadata associated with results selected after first query to determine latent intent of the user. The server receives a second query and determines that the second query includes terms related to the first query. The server determines a latent intent of the second query based on the correlation and provides instructions to the user computing device to render a graphical user interface, the graphical user interface comprising the query results.