公开(公告)号：US12141132B1

公开(公告)日：2024-11-12

申请号：US18070261

申请日：2022-11-28

Applicant: GOOGLE LLC

Inventor： Matthias Heiler ,  Behshad Behzadi ,  Evgeny A. Cherepanov ,  Nils Grimsmo ,  Aurélien Boffy ,  Alessandro Agostini ,  Karoly Csalogany ,  Fredrik Bergenlid ,  Marcin M. Nowak-Przygodzki

IPC: G06F16/242 ,  G06F16/23 ,  G06F16/2457 ,  G06F16/248 ,  G06F16/33 ,  G06F16/9032 ,  G06F16/9535

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining query refinements using search data. In one aspect, a method includes receiving a first query and a second query each comprising one or more n-grams for a user session, determining a first set of query refinements for the first query, determining a second set of query refinements from the first set of query refinements, each query refinement in the second set of query refinements including at least one n-gram that is similar to an n-gram from the first query and at least on n-gram that is similar to an n-gram from the second query, scoring each query refinement in the second set of query refinements, selecting a third query from a group consisting of the second set of query refinements and the second query, and providing the third query as input to a search operation.

公开(公告)号：US11514035B1

公开(公告)日：2022-11-29

申请号：US16889166

申请日：2020-06-01

Applicant: Google LLC

Inventor： Matthias Heiler ,  Behshad Behzadi ,  Evgeny A. Cherepanov ,  Nils Grimsmo ,  Aurelien Boffy ,  Alessandro Agostini ,  Karoly Csalogany ,  Fredrik Bergenlid ,  Marcin M. Nowak-Przygodzki

IPC: G06F16/242 ,  G06F16/23 ,  G06F16/9032 ,  G06F16/2457 ,  G06F16/9535 ,  G06F16/248

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining query refinements using search data. In one aspect, a method includes receiving a first query and a second query each comprising one or more n-grams for a user session, determining a first set of query refinements for the first query, determining a second set of query refinements from the first set of query refinements, each query refinement in the second set of query refinements including at least one n-gram that is similar to an n-gram from the first query and at least on n-gram that is similar to an n-gram from the second query, scoring each query refinement in the second set of query refinements, selecting a third query from a group consisting of the second set of query refinements and the second query, and providing the third query as input to a search operation.

公开(公告)号：US20250139379A1

公开(公告)日：2025-05-01

申请号：US18385270

申请日：2023-10-30

Applicant: GOOGLE LLC

Inventor： Sanil Jain ,  Wei Yu ,  Alessandro Agostini ,  Agoston Weisz ,  Michael Andrew Goodman ,  Attila Dankovics ,  Elle Chae ,  Evgeny Sluzhaev ,  Amin Ghafouri ,  Golnaz Ghiasi ,  Igor Petrovski ,  Konstantin Shagin ,  Marcelo Menegali ,  Oscar Akerlund ,  Rakesh Shivanna ,  Thang Luong ,  Tiffany Chen ,  Vikas Peswani ,  Yifeng Lu

IPC: G06F40/40 ,  G06F16/483

Abstract: Implementations relate to generating multi-modal response(s) through utilization of large language model(s) (LLM(s)) and other generative model(s). Processor(s) of a system can: receive natural language (NL) based input, generate a multi-modal response that is responsive to the NL based output, and cause the multi-modal response to be rendered. In some implementations, and in generating the multi-modal response, the processor(s) can process, using a LLM, LLM input to generate LLM output, and determine, based on the LLM output, textual content and generative multimedia content for inclusion in the multi-modal response. In some implementations, the generative multimedia content can be generated by another generative model (e.g., an image generator, a video generator, an audio generator, etc.) based on generative multimedia content prompt(s) included in the LLM output and that is indicative of the generative multimedia content. In various implementations, the generative multimedia content can be interleaved between segments of the textual content.

公开(公告)号：US20240078374A1

公开(公告)日：2024-03-07

申请号：US17957489

申请日：2022-09-30

Applicant: GOOGLE LLC

Inventor： Ajay Gokhale ,  Jiawei Chen ,  Alvin Abdagic ,  Adrien Olczak ,  Alessandro Agostini ,  Alexander Robertson ,  Cristian Udrescu ,  Jackie Xiang ,  Jennifer Daniel ,  Keqian Yan ,  Mehek Sharma ,  Nicolo D'Ercole ,  Yang Lu ,  Dror Ayalon

IPC: G06F40/166 ,  G06F3/0482 ,  G06F3/0488 ,  G06F40/279 ,  G10L15/197 ,  G10L15/22 ,  G10L25/63

CPC classification number: G06F40/166 ,  G06F3/0482 ,  G06F3/0488 ,  G06F40/279 ,  G10L15/197 ,  G10L15/22 ,  G10L25/63 ,  G10L2015/223

Abstract: Implementations described herein relate to causing emoji(s) that are associated with a given emotion class expressed by a spoken utterance to be visually rendered for presentation to a user at a display of a client device of the user. Processor(s) of the client device may receive audio data that captures the spoken utterance, process the audio data to generate textual data that is predicted to correspond to the spoken utterance, and cause a transcription of the textual data to be visually rendered for presentation to the user via the display. Further, the processor(s) may determine, based on processing the textual data, whether the spoken utterance expresses a given emotion class. In response to determining that the spoken utterance expresses the given emotion class, the processor(s) may cause emoji(s) that are stored in association with the given emotion class to be visually rendered for presentation to the user via the display.

公开(公告)号：US10691680B1

公开(公告)日：2020-06-23

申请号：US15617184

申请日：2017-06-08

Applicant: Google LLC

Inventor： Matthias Heiler ,  Behshad Behzadi ,  Evgeny A. Cherepanov ,  Nils Grimsmo ,  Aurelien Boffy ,  Alessandro Agostini ,  Karoly Csalogany ,  Fredrik Bergenlid ,  Marcin M. Nowak-Przygodzki

IPC: G06F16/242 ,  G06F16/23 ,  G06F16/248 ,  G06F16/9535 ,  G06F16/2457 ,  G06F16/9032

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining query refinements using search data. In one aspect, a method includes receiving a first query and a second query each comprising one or more n-grams for a user session, determining a first set of query refinements for the first query, determining a second set of query refinements from the first set of query refinements, each query refinement in the second set of query refinements including at least one n-gram that is similar to an n-gram from the first query and at least on n-gram that is similar to an n-gram from the second query, scoring each query refinement in the second set of query refinements, selecting a third query from a group consisting of the second set of query refinements and the second query, and providing the third query as input to a search operation.