公开(公告)号：US20250165122A1

公开(公告)日：2025-05-22

申请号：US19029520

申请日：2025-01-17

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni ,  David Roy Schairer

IPC: G06F3/0482 ,  G06F3/04812 ,  G06F3/0484 ,  G10L15/22 ,  H04L12/28 ,  H04L67/12

Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.

公开(公告)号：US12248659B2

公开(公告)日：2025-03-11

申请号：US18200979

申请日：2023-05-23

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni ,  David Roy Schairer

IPC: G06F3/0484 ,  G06F3/04812 ,  G06F3/0482 ,  G10L15/22 ,  H04L12/28 ,  H04L67/12

Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.

公开(公告)号：US12175978B2

公开(公告)日：2024-12-24

申请号：US18201987

申请日：2023-05-25

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni

IPC: G10L17/22 ,  G06N3/006 ,  G10L15/08 ,  G10L15/22 ,  G10L15/30 ,  H04L51/02 ,  H04L51/043 ,  H04L67/12

Abstract: Transferring (e.g., automatically) an automated assistant routine between client devices during execution of the automated assistant routine. The automated assistant routine can correspond to a set of actions to be performed by one or more agents and/or one or more devices. While content, corresponding to an action of the routine, is being rendered at a particular device, the user may walk away from the particular device and toward a separate device. The automated assistant routine can be automatically transferred in response, and the separate device can continue to rendering the content for the user.

公开(公告)号：US12135748B2

公开(公告)日：2024-11-05

申请号：US18207987

申请日：2023-06-09

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni

IPC: G06F16/9032 ,  G06F16/33 ,  G06F40/216 ,  G06F40/35 ,  G06N3/006 ,  G06N3/02 ,  G06N3/084 ,  G06N5/022 ,  G10L15/18 ,  G10L15/22 ,  G10L15/26

Abstract: Generating and/or recommending command bundles for a user of an automated assistant. A command bundle comprises a plurality of discrete actions that can be performed by an automated assistant. One or more of the actions of a command bundle can cause transmission of a corresponding command and/or other data to one or more devices and/or agents that are distinct from devices and/or agents to which data is transmitted based on other action(s) of the bundle. Implementations determine command bundles that are likely relevant to a user, and present those command bundles as suggestions to the user. In some of those implementations, a machine learning model is utilized to generate a user action embedding for the user, and a command bundle embedding for each of a plurality of command bundles. Command bundle(s) can be selected for suggestion based on comparison of the user action embedding and the command bundle embeddings.

公开(公告)号：US20240144927A1

公开(公告)日：2024-05-02

申请号：US18406522

申请日：2024-01-08

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni

IPC: G10L15/22 ,  G06F3/16 ,  G10L13/00 ,  G10L15/26 ,  G10L15/30

CPC classification number: G10L15/22 ,  G06F3/165 ,  G10L13/00 ,  G10L15/26 ,  G10L15/30 ,  G10L2015/223

Abstract: Implementations relate to mitigating client device latency in rendering of remotely generated automated assistant content. Some of those implementations mitigate client device latency between rendering of multiple instances of output that are each based on content that is responsive to a corresponding automated assistant action of a multiple action request. For example, those implementations can reduce latency between rendering of first output that is based on first content responsive to a first automated assistant action of a multiple action request, and second output that is based on second content responsive to a second automated assistant action of the multiple action request.

公开(公告)号：US11893309B2

公开(公告)日：2024-02-06

申请号：US17691889

申请日：2022-03-10

Applicant: GOOGLE LLC

Inventor： Tomer Amarilio ,  Yuzhao Ni ,  Bryan Allen ,  Norbert Tydingco ,  Will Donnelly ,  Feng Yuan ,  Nathaniel Nesiba ,  Anurag Jain ,  Jacky Cheung ,  Ronghui Zhu ,  Chunya Hua ,  Gregory Kielian

IPC: G06F3/16 ,  G10L15/08 ,  G10L15/22

CPC classification number: G06F3/167 ,  G10L15/08 ,  G10L15/22 ,  G06F2221/2111 ,  G10L2015/223

Abstract: In response to a user interacting with a tangible peripheral assistant control device (e.g., depressing a button of the device), causing an automated assistant to perform one or more actions. The action(s) performed can be based on input previously provided by the user in configuring the peripheral assistant control device. The action(s) performed in response to interaction with the peripheral assistant control device can vary based on one or more conditions, such as which user is currently active, where the peripheral assistant control device is currently located (which can optionally be inferred based on which of multiple assistant computing devices the button is paired with), and/or the current state of one or more smart devices and/or other devices (e.g., as determined based on a device topology). A utility of the peripheral assistant control device can be automatically extended beyond what was specifically requested by a user during configuration.

公开(公告)号：US20240036541A1

公开(公告)日：2024-02-01

申请号：US18379003

申请日：2023-10-11

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni ,  David Roy Schairer

IPC: G05B19/042 ,  G06F9/451 ,  G06F3/04847 ,  H04L12/28 ,  H04L67/53

CPC classification number: G05B19/042 ,  G06F9/451 ,  G06F3/04847 ,  H04L12/282 ,  H04L67/53 ,  G05B2219/2642

Abstract: Efficient control and/or linking of smart network connected devices. Some implementations are directed to rendering, within an active application that enables control of multiple smart devices from multiple parties, both: (1) an interactive graphical interface element that, when interacted with, causes corresponding control of smart device(s) of a third-party (3P); and (2) a selectable element that, when selected, causes execution of a deeplink to cause a 3P application to open in a state that presents additional information for the smart device(s). Some implementations are additionally or alternatively directed to, in response to determining that a 3P application is installed at a client device, but a smart device topology lacks any entries for 3P smart devices of the 3P, efficiently adding one or more particular smart devices of the 3P to the smart device topology.

公开(公告)号：US20230401259A1

公开(公告)日：2023-12-14

申请号：US18207987

申请日：2023-06-09

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni

IPC: G06F16/9032 ,  G10L15/26 ,  G06N3/02 ,  G10L15/22 ,  G06F16/33 ,  G06N3/006 ,  G06N3/084 ,  G06F40/35 ,  G06F40/216 ,  G10L15/18

CPC classification number: G06F16/90332 ,  G10L15/26 ,  G06N3/02 ,  G10L15/22 ,  G06F16/3334 ,  G06N3/006 ,  G06N3/084 ,  G06F40/35 ,  G06F40/216 ,  G10L15/18 ,  G10L2015/223 ,  G06N5/022

Abstract: Generating and/or recommending command bundles for a user of an automated assistant. A command bundle comprises a plurality of discrete actions that can be performed by an automated assistant. One or more of the actions of a command bundle can cause transmission of a corresponding command and/or other data to one or more devices and/or agents that are distinct from devices and/or agents to which data is transmitted based on other action(s) of the bundle. Implementations determine command bundles that are likely relevant to a user, and present those command bundles as suggestions to the user. In some of those implementations, a machine learning model is utilized to generate a user action embedding for the user, and a command bundle embedding for each of a plurality of command bundles. Command bundle(s) can be selected for suggestion based on comparison of the user action embedding and the command bundle embeddings.

公开(公告)号：US11693533B2

公开(公告)日：2023-07-04

申请号：US17676624

申请日：2022-02-21

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni ,  David Roy Schairer

IPC: G06F3/0484 ,  G10L15/22 ,  H04L12/28 ,  G06F3/0482 ,  H04L67/12 ,  G06F3/04812 ,  H04L67/125

CPC classification number: G06F3/0482 ,  G06F3/0484 ,  G06F3/04812 ,  G10L15/22 ,  H04L12/282 ,  H04L67/12 ,  G10L2015/223

Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.

公开(公告)号：US20220156040A1

公开(公告)日：2022-05-19

申请号：US17588460

申请日：2022-01-31

Applicant: GOOGLE LLC

Inventor： David Roy Schairer ,  Triona Butler ,  Cindy Tran ,  Mark Spates, IV ,  Di Lin ,  Yuzhao Ni ,  Lisa Williams

IPC: G06F3/16 ,  G06F3/04847 ,  G06F3/04883 ,  G10L15/22 ,  H04L51/02

Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other functions that the connected device is capable of performing. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with the connected device. Each graphical control element can be arranged according to a status of the connected device, in order to reflect how the connected device is operating simultaneous to the presentation of the composite graphical assistant interface.