-
1.
公开(公告)号:US11947923B1
公开(公告)日:2024-04-02
申请号:US18520218
申请日:2023-11-27
Applicant: GOOGLE LLC
Inventor: Sanil Jain , Wei Yu , Ágoston Weisz , Michael Andrew Goodman , Diana Avram , Amin Ghafouri , Golnaz Ghiasi , Igor Petrovski , Khyatti Gupta , Oscar Akerlund , Evgeny Sluzhaev , Rakesh Shivanna , Thang Luong , Komal Singh , Yifeng Lu , Vikas Peswani
Abstract: Implementations relate to managing multimedia content that is obtained by large language model(s) (LLM(s)) and/or generated by other generative model(s). Processor(s) of a system can: receive natural language (NL) based input that requests multimedia content, generate a response that is responsive to the NL based input, and cause the response to be rendered. In some implementations, and in generating the response, the processor(s) can process, using a LLM, LLM input to generate LLM output, and determine, based on the LLM output, at least multimedia content to be included in the response. Further, the processor(s) can evaluate the multimedia content to determine whether it should be included in the response. In response to determining that the multimedia content should not be included in the response, the processor(s) can cause the response, including alternative multimedia content or other textual content, to be rendered.
-
2.
公开(公告)号:US12277400B1
公开(公告)日:2025-04-15
申请号:US18590498
申请日:2024-02-28
Applicant: GOOGLE LLC
Inventor: Sanil Jain , Wei Yu , Ágoston Weisz , Michael Andrew Goodman , Diana Avram , Amin Ghafouri , Golnaz Ghiasi , Igor Petrovski , Khyatti Gupta , Oscar Akerlund , Evgeny Sluzhaev , Rakesh Shivanna , Thang Luong , Komal Singh , Yifeng Lu , Vikas Peswani
Abstract: Implementations relate to managing multimedia content that is obtained by large language model(s) (LLM(s)) and/or generated by other generative model(s). Processor(s) of a system can: receive natural language (NL) based input that requests multimedia content, generate a response that is responsive to the NL based input, and cause the response to be rendered. In some implementations, and in generating the response, the processor(s) can process, using a LLM, LLM input to generate LLM output, and determine, based on the LLM output, at least multimedia content to be included in the response. Further, the processor(s) can evaluate the multimedia content to determine whether it should be included in the response. In response to determining that the multimedia content should not be included in the response, the processor(s) can cause the response, including alternative multimedia content or other textual content, to be rendered.
-
3.
公开(公告)号:US12287827B2
公开(公告)日:2025-04-29
申请号:US18230457
申请日:2023-08-04
Applicant: GOOGLE LLC
Inventor: Diana Avram , Mugurel-Ionut Andreica , Alice Liang , Andrea D'olimpio , Cliff Kuang , Andre Elisseeff , Dana Ritter , Florian Hasler , Radu Voroneanu
IPC: G06F16/638 , G06F16/635 , H04L67/50
Abstract: Implementations relate to identifying actions performed by a user while the user is interacting with multiple applications and providing a routine suggestion to the user based on the identified actions. While a user is interacting with one or more applications, the user actions are determined. The user actions are compared to one or more template routines and a template routine is selected that matches the actions of the user and provided to the user as a suggested routine. The suggested routine can be implemented by an automated assistant to perform the actions of the template by providing a corresponding command.
-
公开(公告)号:US12271742B2
公开(公告)日:2025-04-08
申请号:US18230561
申请日:2023-08-04
Applicant: GOOGLE LLC
Inventor: Cliff Kuang , Diana Avram , Mugurel-Ionut Andreica , Radu Voroneanu , Sneha Ashok , Deepak Goyal , Kyunghoon Lee , Alice Liang , Dana Ritter , Adam Coimbra , Anton Berezin , Andre Elisseeff
IPC: G06F9/451 , G06F3/0482 , G06F3/0484
Abstract: Implementations relate to determining a rendering type for an application that is executing automatically. Based on user interactions with an application that is associated with specified input from the user while the user is interacting with the application, a confidence metric is generated for each specified input and a rendering type is determined based on the confidence metrics. Subsequently, when the user requests that a sequence of actions be performed, the application will be displayed according to the rendering type.
-
5.
公开(公告)号:US20250045327A1
公开(公告)日:2025-02-06
申请号:US18230457
申请日:2023-08-04
Applicant: GOOGLE LLC
Inventor: Diana Avram , Mugurel-Ionut Andreica , Alice Liang , Andrea D'olimpio , Cliff Kuang , Andre Elisseeff , Dana Ritter , Florian Hasler , Radu Voroneanu
IPC: G06F16/638 , G06F16/635 , H04L67/50
Abstract: Implementations relate to identifying actions performed by a user while the user is interacting with multiple applications and providing a routine suggestion to the user based on the identified actions. While a user is interacting with one or more applications, the user actions are determined. The user actions are compared to one or more template routines and a template routine is selected that matches the actions of the user and provided to the user as a suggested routine. The suggested routine can be implemented by an automated assistant to perform the actions of the template by providing a corresponding command.
-
公开(公告)号:US20250045079A1
公开(公告)日:2025-02-06
申请号:US18230566
申请日:2023-08-04
Applicant: GOOGLE LLC
Inventor: Diana Avram , Mugurel-Ionut Andreica , Andrea D'olimpio , Bogdan Prisacari , Felix Weissenberger , Andre Elisseeff , Cliff Kuang , Dana Ritter , Adam Coimbra
IPC: G06F9/451
Abstract: Implementations relate to identifying actions performed by a user while the user is interacting with an application and providing a routine suggestion to the user based on the identified actions. While a user is interacting with an application, screenshots of the user actions are captured and processed to determine what actions were performed by the user. The identified actions are compared to one or more template routines and a template routine is selected that matches the actions and intent of the user and provided to the user as a suggested routine. The suggested routine can be implemented by an automated assistant to perform the actions of the template by providing a corresponding command.
-
公开(公告)号:US20250045071A1
公开(公告)日:2025-02-06
申请号:US18230561
申请日:2023-08-04
Applicant: GOOGLE LLC
Inventor: Cliff Kuang , Diana Avram , Mugurel-Ionut Andreica , Radu Voroneanu , Sneha Ashok , Deepak Goyal , Kyunghoon Lee , Alice Liang , Dana Ritter , Adam Coimbra , Anton Berezin , Andre Elisseeff
IPC: G06F9/451 , G06F3/0482 , G06F3/0484
Abstract: Implementations relate to determining a rendering type for an application that is executing automatically. Based on user interactions with an application that is associated with specified input from the user while the user is interacting with the application, a confidence metric is generated for each specified input and a rendering type is determined based on the confidence metrics. Subsequently, when the user requests that a sequence of actions be performed, the application will be displayed according to the rendering type.
-
-
-
-
-
-