公开(公告)号：US20240420696A1

公开(公告)日：2024-12-19

申请号：US18814060

申请日：2024-08-23

Applicant: GOOGLE LLC

Inventor： Gleb Skobeltsyn ,  Olga Kapralova ,  Konstantin Shagin ,  Vladimir Vuskovic ,  Yufei Zhao ,  Bradley Nelson ,  Alessio Macrì ,  Abraham Lee

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/28

Abstract: Implementations described herein relate to providing suggestions, via a display modality, for completing a spoken utterance for an automated assistant, in order to reduce a frequency and/or a length of time that the user will participate in a current and/or subsequent dialog session with the automated assistant. A user request can be compiled from content of an ongoing spoken utterance and content of any selected suggestion elements. When a currently compiled portion of the user request (from content of a selected suggestion(s) and an incomplete spoken utterance) is capable of being performed via the automated assistant, any actions corresponding to the currently compiled portion of the user request can be performed via the automated assistant. Furthermore, any further content resulting from performance of the actions, along with any discernible context, can be used for providing further suggestions.

公开(公告)号：US20250139379A1

公开(公告)日：2025-05-01

申请号：US18385270

申请日：2023-10-30

Applicant: GOOGLE LLC

Inventor： Sanil Jain ,  Wei Yu ,  Alessandro Agostini ,  Agoston Weisz ,  Michael Andrew Goodman ,  Attila Dankovics ,  Elle Chae ,  Evgeny Sluzhaev ,  Amin Ghafouri ,  Golnaz Ghiasi ,  Igor Petrovski ,  Konstantin Shagin ,  Marcelo Menegali ,  Oscar Akerlund ,  Rakesh Shivanna ,  Thang Luong ,  Tiffany Chen ,  Vikas Peswani ,  Yifeng Lu

IPC: G06F40/40 ,  G06F16/483

Abstract: Implementations relate to generating multi-modal response(s) through utilization of large language model(s) (LLM(s)) and other generative model(s). Processor(s) of a system can: receive natural language (NL) based input, generate a multi-modal response that is responsive to the NL based output, and cause the multi-modal response to be rendered. In some implementations, and in generating the multi-modal response, the processor(s) can process, using a LLM, LLM input to generate LLM output, and determine, based on the LLM output, textual content and generative multimedia content for inclusion in the multi-modal response. In some implementations, the generative multimedia content can be generated by another generative model (e.g., an image generator, a video generator, an audio generator, etc.) based on generative multimedia content prompt(s) included in the LLM output and that is indicative of the generative multimedia content. In various implementations, the generative multimedia content can be interleaved between segments of the textual content.

公开(公告)号：US12073832B2

公开(公告)日：2024-08-27

申请号：US17588451

申请日：2022-01-31

Applicant: GOOGLE LLC

Inventor： Gleb Skobeltsyn ,  Olga Kapralova ,  Konstantin Shagin ,  Vladimir Vuskovic ,  Yufei Zhao ,  Bradley Nelson ,  Alessio Macrì ,  Abraham Lee

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/28

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L15/18 ,  G10L15/28 ,  G10L2015/223

Abstract: Implementations described herein relate to providing suggestions, via a display modality, for completing a spoken utterance for an automated assistant, in order to reduce a frequency and/or a length of time that the user will participate in a current and/or subsequent dialog session with the automated assistant. A user request can be compiled from content of an ongoing spoken utterance and content of any selected suggestion elements. When a currently compiled portion of the user request (from content of a selected suggestion(s) and an incomplete spoken utterance) is capable of being performed via the automated assistant, any actions corresponding to the currently compiled portion of the user request can be performed via the automated assistant. Furthermore, any further content resulting from performance of the actions, along with any discernible context, can be used for providing further suggestions.

公开(公告)号：US20220157309A1

公开(公告)日：2022-05-19

申请号：US17588451

申请日：2022-01-31

Applicant: GOOGLE LLC

Inventor： Gleb Skobeltsyn ,  Olga Kapralova ,  Konstantin Shagin ,  Vladimir Vuskovic ,  Yufei Zhao ,  Bradley Nelson ,  Alessio Macrì ,  Abraham Lee

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/28

Abstract: Implementations described herein relate to providing suggestions, via a display modality, for completing a spoken utterance for an automated assistant, in order to reduce a frequency and/or a length of time that the user will participate in a current and/or subsequent dialog session with the automated assistant. A user request can be compiled from content of an ongoing spoken utterance and content of any selected suggestion elements. When a currently compiled portion of the user request (from content of a selected suggestion(s) and an incomplete spoken utterance) is capable of being performed via the automated assistant, any actions corresponding to the currently compiled portion of the user request can be performed via the automated assistant. Furthermore, any further content resulting from performance of the actions, along with any discernible context, can be used for providing further suggestions.

公开(公告)号：US11238857B2

公开(公告)日：2022-02-01

申请号：US16343683

申请日：2019-02-07

Applicant: Google LLC

Inventor： Gleb Skobeltsyn ,  Olga Kapralova ,  Konstantin Shagin ,  Vladimir Vuskovic ,  Yufei Zhao ,  Bradley Nelson ,  Alessio Macrí ,  Abraham Lee

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/18 ,  G10L15/28

Abstract: Implementations described herein relate to providing suggestions, via a display modality, for completing a spoken utterance for an automated assistant, in order to reduce a frequency and/or a length of time that the user will participate in a current and/or subsequent dialog session with the automated assistant. A user request can be compiled from content of an ongoing spoken utterance and content of any selected suggestion elements. When a currently compiled portion of the user request (from content of a selected suggestion(s) and an incomplete spoken utterance) is capable of being performed via the automated assistant, any actions corresponding to the currently compiled portion of the user request can be performed via the automated assistant. Furthermore, any further content resulting from performance of the actions, along with any discernible context, can be used for providing further suggestions.

公开(公告)号：US20210280180A1

公开(公告)日：2021-09-09

申请号：US16343683

申请日：2019-02-07

Applicant: Google LLC

Inventor： Gleb Skobeltsyn ,  Olga Kapralova ,  Konstantin Shagin ,  Vladimir Vuskovic ,  Yufei Zhao ,  Bradley Nelson ,  Alessio Macrì ,  Abraham Lee

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/28 ,  G10L15/18

Abstract: Implementations described herein relate to providing suggestions, via a display modality, for completing a spoken utterance for an automated assistant, in order to reduce a frequency and/or a length of time that the user will participate in a current and/or subsequent dialog session with the automated assistant. A user request can be compiled from content of an ongoing spoken utterance and content of any selected suggestion elements. When a currently compiled portion of the user request (from content of a selected suggestion(s) and an incomplete spoken utterance) is capable of being performed via the automated assistant, any actions corresponding to the currently compiled portion of the user request can be performed via the automated assistant. Furthermore, any further content resulting from performance of the actions, along with any discernible context, can be used for providing further suggestions.