公开(公告)号：US20210072953A1

公开(公告)日：2021-03-11

申请号：US16610815

申请日：2019-02-01

Applicant: Google LLC

Inventor： Tomer Amarilio ,  Yuzhao Ni ,  Bryan Allen ,  Norbert Tydingco ,  Will Donnelly ,  Feng Yuan ,  Nathaniel Nesiba ,  Anurag Jain ,  Jacky Cheung ,  Ronghui Zhu ,  Chunya Hua ,  Gregory Kielian

IPC: G06F3/16 ,  G10L15/22 ,  G10L15/08

Abstract: In response to a user interacting with a tangible peripheral assistant control device (e.g., depressing a button of the device), causing an automated assistant to perform one or more actions. The action(s) performed can be based on input previously provided by the user in configuring the peripheral assistant control device. The action(s) performed in response to interaction with the peripheral assistant control device can vary based on one or more conditions, such as which user is currently active, where the peripheral assistant control device is currently located (which can optionally be inferred based on which of multiple assistant computing devices the button is paired with), and/or the current state of one or more smart devices and/or other devices (e.g., as determined based on a device topology). A utility of the peripheral assistant control device can be automatically extended beyond what was specifically requested by a user during configuration.

公开(公告)号：US20200326837A1

公开(公告)日：2020-10-15

申请号：US16339269

申请日：2018-06-24

Applicant: Google LLC

Inventor： Yuzhao Ni

IPC: G06F3/0484 ,  H04N5/232 ,  G06F3/0488 ,  G06K9/00

Abstract: Implementations discussed herein relate to systems, methods, and apparatuses for controlling one or more internet of things (IoT) devices via a graphical camera interface of a portable electronic device. The graphical camera interface can be presented at the portable electronic device in response to the user accessing a camera application via the portable electronic device and directing a camera of the portable electronic device at the IoT device. One or more images generated from an output of the camera can be processed to identify the IoT device that the user is intending to control. Information related to a context in which the user aimed their camera at the IoT device can be used to assist in narrowing down a selection of the IoT device from multiple different IoT devices that may be associated with the user and/or an image captured by the camera.

公开(公告)号：US20190102482A1

公开(公告)日：2019-04-04

申请号：US15730514

申请日：2017-10-11

Applicant: Google LLC

Inventor： Yuzhao Ni

IPC: G06F17/30 ,  G10L15/22 ,  G10L15/26 ,  G06N3/02

CPC classification number: G06F16/90332 ,  G06F16/3334 ,  G06F17/2715 ,  G06F17/279 ,  G06N3/006 ,  G06N3/02 ,  G06N3/084 ,  G06N5/022 ,  G10L15/22 ,  G10L15/26 ,  G10L2015/223

Abstract: Generating and/or recommending command bundles for a user of an automated assistant. A command bundle comprises a plurality of discrete actions that can be performed by an automated assistant. One or more of the actions of a command bundle can cause transmission of a corresponding command and/or other data to one or more devices and/or agents that are distinct from devices and/or agents to which data is transmitted based on other action(s) of the bundle. Implementations determine command bundles that are likely relevant to a user, and present those command bundles as suggestions to the user. In some of those implementations, a machine learning model is utilized to generate a user action embedding for the user, and a command bundle embedding for each of a plurality of command bundles. Command bundle(s) can be selected for suggestion based on comparison of the user action embedding and the command bundle embeddings.

公开(公告)号：US20190096406A1

公开(公告)日：2019-03-28

申请号：US16203521

申请日：2018-11-28

Applicant: Google LLC

Inventor： Yuzhao Ni ,  Bo Wang ,  Barnaby James ,  Pravir Gupta ,  David Schairer

IPC: G10L15/22 ,  G10L15/18 ,  G10L15/06 ,  G06F17/30 ,  G10L15/08 ,  G10L15/183 ,  G06F17/28 ,  G06F3/16

Abstract: In various implementations, upon receiving a given voice command from a user, a voice-based trigger may be selected from a library of voice-based triggers previously used across a population of users. The library may include association(s) between each voice-based trigger and responsive action(s) previously performed in response to the voice-based trigger. The selecting may be based on a measure of similarity between the given voice command and the selected voice-based trigger. One or more responsive actions associated with the selected voice-based trigger in the library may be determined. Based on the one or more responsive actions, current responsive action(s) may be performed by the client device. Feedback associated with performance of the current responsive action(s) may be received from the user and used to alter a strength of an association between the selected voice-based trigger and the one or more responsive actions.