公开(公告)号：US10937427B2

公开(公告)日：2021-03-02

申请号：US16877799

申请日：2020-05-19

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Bo Wang ,  Steve Chen ,  Sunil Vemuri ,  Barnaby James ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/18 ,  G10L15/30

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

公开(公告)号：US20200279564A1

公开(公告)日：2020-09-03

申请号：US16877799

申请日：2020-05-19

Applicant: Google LLC

Inventor： Ulas Kirazci ,  Bo Wang ,  Steve Chen ,  Sunil Vemuri ,  Barnaby James ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F3/16 ,  G06F16/9535 ,  G06F40/30 ,  G10L15/18 ,  G10L15/30

Abstract: Some implementations are directed to selective invocation of a particular third-party (3P) agent by an automated assistant to achieve an intended action determined by the automated assistant during a dynamic dialog between the automated assistant and a user. In some of those implementations, the particular 3P agent is invoked with value(s) for parameter(s) that are determined during the dynamic dialog; and/or the particular 3P agent is selected, from a plurality of candidate 3P agents, for invocation based on the determined value(s) for the parameter(s) and/or based on other criteria. In some of those implementations, the automated assistant invokes the particular 3P agent by transmitting, to the particular 3P agent, a 3P invocation request that includes the determined value(s) for the parameter(s).

公开(公告)号：US20200075002A1

公开(公告)日：2020-03-05

申请号：US16251982

申请日：2019-01-18

Applicant: Google LLC

Inventor： April Pufahl ,  Jared Strawderman ,  Harry Yu ,  Adriana Olmos Antillon ,  Jonathan Livni ,  Okan Kolak ,  James Giangola ,  Nitin Khandelwal ,  Jason Kearns ,  Andrew Watson ,  Joseph Ashear ,  Valerie Nygaard

IPC: G10L15/22 ,  G06F1/16 ,  G06F3/16

Abstract: Systems, methods, and apparatus for using a multimodal response in the dynamic generation of client device output that is tailored to a current modality of a client device is disclosed herein. Multimodal client devices can engage in a variety of interactions across the multimodal spectrum including voice only interactions, voice forward interactions, multimodal interactions, visual forward interactions, visual only interactions etc. A multimodal response can include a core message to be rendered for all interaction types as well as one or more modality dependent components to provide a user with additional information.

公开(公告)号：US20180096284A1

公开(公告)日：2018-04-05

申请号：US15815368

申请日：2017-11-16

Applicant: Google LLC

Inventor： Robert Stets ,  Valerie Nygaard ,  Bogdan Caprita ,  Bradley M. Abrams ,  Jason Brant Douglas

IPC: G06Q10/06 ,  G10L15/22

CPC classification number: G06Q10/063112 ,  G06F9/46 ,  G06F16/951 ,  G10L15/22 ,  G10L2015/223

Abstract: An example method includes receiving, by one or more processors, a representation of an utterance spoken at a computing device; identifying, by a first computational agent from a plurality of computational agents and based on the utterance, a multi-element task to be performed, wherein the plurality of computational agents includes one or more first party computational agents and a plurality of third-party computational agents; and performing, by the first computational agent, a first sub-set of elements of the multi-element task, wherein performing the first sub-set of elements comprises selecting a second computational agent from the plurality of computational agents to perform a second sub-set of elements of the multi-element task.

公开(公告)号：US20180096283A1

公开(公告)日：2018-04-05

申请号：US15815353

申请日：2017-11-16

Applicant: Google LLC

Inventor： Bo Wang ,  Lei Zhong ,  Barnaby John James ,  Saisuresh Krishnakumaran ,  Robert Stets ,  Bogdan Caprita ,  Valerie Nygaard

IPC: G06Q10/06 ,  G10L15/22 ,  G10L15/08

CPC classification number: G06Q10/063112 ,  G06F16/951 ,  G10L13/00 ,  G10L15/08 ,  G10L15/22 ,  G10L2015/088 ,  G10L2015/223

Abstract: An example method includes receiving, by a computational assistant executing at one or more processors, a representation of an utterance spoken at a computing device; identifying, based on the utterance, a task to be performed; determining a capability level of a first party (1P) agent to perform the task; determining capability levels of respective third party (3P) agents of a plurality of 3P agents to perform the task; responsive to determining that the capability level of the 1P agent does not satisfy a threshold capability level, that a capability level of a particular 3P agent of the plurality of 3P agents is a greatest of the determined capability levels, and that the capability level of the particular 3P agent satisfies the threshold capability level, selecting the particular 3P agent to perform the task; and performing one or more actions determined by the selected agent to perform the task.