公开(公告)号：US20230343323A1

公开(公告)日：2023-10-26

申请号：US17726244

申请日：2022-04-21

Applicant: GOOGLE LLC

Inventor： Martin Baeuml ,  Thushan Amarasiriwardena ,  Roberto Pieraccini ,  Gianluca Martini

IPC: G10L13/10 ,  G10L15/22 ,  G10L15/18

CPC classification number: G10L13/10 ,  G10L15/22 ,  G10L15/1815 ,  G10L2015/223

Abstract: Implementations relate to dynamically adapting a given assistant output based on a given persona, from among a plurality of disparate personas, assigned to an automated assistant. In some implementations, the given assistant output can be generated and subsequently adapted based on the given persona assigned to the automated assistant. In other implementations, the given assistant output can be generated specific to the given persona and without having to subsequently adapt the given assistant output to the given persona. Notably, the given assistant output can include a stream of textual content to be synthesized for audible presentation to the user, and a stream of visual cues utilized in controlling a display of a client device and/or in controlling a visualized representation of the automated assistant. Various implementations utilize large language models (LLMs), or output previously generated utilizing LLMs, to reflect the given persona in the given assistant output.

公开(公告)号：US12223944B2

公开(公告)日：2025-02-11

申请号：US17744440

申请日：2022-05-13

Applicant: GOOGLE LLC

Inventor： Martin Baeuml ,  Thushan Amarasiriwardena ,  Roberto Pieraccini ,  Gianluca Martini

IPC: G06F40/56 ,  G06F3/16 ,  G06F16/332 ,  G06F40/169 ,  G06T7/20 ,  G06V20/40 ,  G06V40/20 ,  G10L13/02 ,  G10L13/033 ,  G10L13/08 ,  G10L13/10 ,  G10L15/06 ,  G10L15/18 ,  G10L15/183 ,  G10L15/22 ,  G10L25/57 ,  H04N5/04

Abstract: Implementations relate to dynamically adapting a given assistant output based on a given persona, from among a plurality of disparate personas, assigned to an automated assistant. In some implementations, the given assistant output can be generated and subsequently adapted based on the given persona assigned to the automated assistant. In other implementations, the given assistant output can be generated specific to the given persona and without having to subsequently adapt the given assistant output to the given persona. Notably, the given assistant output can include a stream of textual content to be synthesized for audible presentation to the user, and a stream of visual cues utilized in controlling a display of a client device and/or in controlling a visualized representation of the automated assistant. Various implementations utilize large language models (LLMs), or output previously generated utilizing LLMs, to reflect the given persona in the given assistant output.

公开(公告)号：US11170772B2

公开(公告)日：2021-11-09

申请号：US16269275

申请日：2019-02-06

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Adam Coimbra ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena ,  Yudong Sun ,  Xiao Gao

IPC: G10L15/22 ,  G06F3/0485 ,  G06F3/16 ,  G10L13/02

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

公开(公告)号：US20230343336A1

公开(公告)日：2023-10-26

申请号：US18217326

申请日：2023-06-30

Applicant: GOOGLE LLC

Inventor： Ulas Kirazci ,  Adam Coimbra ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena

IPC: G10L15/22 ,  G06F9/448 ,  G06F3/16 ,  G10L13/027

CPC classification number: G10L15/22 ,  G06F9/4498 ,  G06F3/167 ,  G10L13/027 ,  G10L2015/223 ,  G10L2015/228

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

公开(公告)号：US20230343324A1

公开(公告)日：2023-10-26

申请号：US17744440

申请日：2022-05-13

Applicant: GOOGLE LLC

Inventor： Martin Baeuml ,  Thushan Amarasiriwardena ,  Roberto Pieraccini ,  Gianluca Martini

IPC: G06V40/20 ,  G10L25/57 ,  G10L15/06 ,  H04N5/04 ,  G06F40/169 ,  G10L15/183 ,  G06T7/20 ,  G10L13/08 ,  G10L15/22 ,  G06V20/40 ,  G10L13/02

CPC classification number: G10L15/22 ,  G06F40/169 ,  G06T7/20 ,  G06V20/40 ,  G06V40/20 ,  G10L13/02 ,  G10L13/08 ,  G10L15/063 ,  G10L15/183 ,  G10L25/57 ,  H04N5/04 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Implementations relate to dynamically adapting a given assistant output based on a given persona, from among a plurality of disparate personas, assigned to an automated assistant. In some implementations, the given assistant output can be generated and subsequently adapted based on the given persona assigned to the automated assistant. In other implementations, the given assistant output can be generated specific to the given persona and without having to subsequently adapt the given assistant output to the given persona. Notably, the given assistant output can include a stream of textual content to be synthesized for audible presentation to the user, and a stream of visual cues utilized in controlling a display of a client device and/or in controlling a visualized representation of the automated assistant. Various implementations utilize large language models (LLMs), or output previously generated utilizing LLMs, to reflect the given persona in the given assistant output.

公开(公告)号：US11200893B2

公开(公告)日：2021-12-14

申请号：US16269275

申请日：2019-02-06

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Adam Coimbra ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena ,  Yudong Sun ,  Xiao Gao

IPC: G10L15/22 ,  G06F3/0485 ,  G06F3/16 ,  G10L13/02

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

公开(公告)号：US10984786B2

公开(公告)日：2021-04-20

申请号：US15774950

申请日：2018-05-07

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Adam Coimbra ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena

IPC: G10L15/22 ,  G06F9/448 ,  G06F3/16 ,  G10L13/027

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

公开(公告)号：US20190340200A1

公开(公告)日：2019-11-07

申请号：US16240609

申请日：2019-01-04

Applicant: Google LLC

Inventor： Adam Coimbra ,  Ulas Kirazci ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena

IPC: G06F16/9032 ,  G10L15/22 ,  G10L13/02 ,  G06F3/0485

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

公开(公告)号：US12125486B2

公开(公告)日：2024-10-22

申请号：US18217326

申请日：2023-06-30

Applicant: GOOGLE LLC

Inventor： Ulas Kirazci ,  Adam Coimbra ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena

IPC: G10L15/22 ,  G06F3/16 ,  G06F9/448 ,  G10L13/027

CPC classification number: G10L15/22 ,  G06F3/167 ,  G06F9/4498 ,  G10L13/027 ,  G10L2015/223 ,  G10L2015/228

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

公开(公告)号：US11735182B2

公开(公告)日：2023-08-22

申请号：US17192230

申请日：2021-03-04

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Adam Coimbra ,  Abraham Lee ,  Wei Dong ,  Thushan Amarasiriwardena

IPC: G10L15/00 ,  G10L15/22 ,  G06F9/448 ,  G06F3/16 ,  G10L13/027

CPC classification number: G10L15/22 ,  G06F3/167 ,  G06F9/4498 ,  G10L13/027 ,  G10L2015/223 ,  G10L2015/228

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.