-
51.
公开(公告)号:US20220187960A1
公开(公告)日:2022-06-16
申请号:US17676624
申请日:2022-02-21
Applicant: GOOGLE LLC
Inventor: Yuzhao Ni , David Roy SCHAIRER
IPC: G06F3/0482 , G06F3/0484 , H04L67/12 , G06F3/04812 , G10L15/22 , H04L12/28
Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.
-
公开(公告)号:US20220187778A1
公开(公告)日:2022-06-16
申请号:US17688583
申请日:2022-03-07
Applicant: GOOGLE LLC
Inventor: Yuzhao Ni , David Roy Schairer
IPC: G05B19/042 , G06F9/451 , G06F3/04847 , H04L12/28 , H04L67/53
Abstract: Efficient control and/or linking of smart network connected devices. Some implementations are directed to rendering, within an active application that enables control of multiple smart devices from multiple parties, both: (1) an interactive graphical interface element that, when interacted with, causes corresponding control of smart device(s) of a third-party (3P); and (2) a selectable element that, when selected, causes execution of a deeplink to cause a 3P application to open in a state that presents additional information for the smart device(s). Some implementations are additionally or alternatively directed to, in response to determining that a 3P application is installed at a client device, but a smart device topology lacks any entries for 3P smart devices of the 3P, efficiently adding one or more particular smart devices of the 3P to the smart device topology.
-
公开(公告)号:US20220148595A1
公开(公告)日:2022-05-12
申请号:US17582847
申请日:2022-01-24
Applicant: Google LLC
Inventor: Yuzhao Ni
Abstract: Generating and/or recommending command bundles for a user of an automated assistant. A command bundle comprises a plurality of discrete actions that can be performed by an automated assistant. One or more of the actions of a command bundle can cause transmission of a corresponding command and/or other data to one or more devices and/or agents that are distinct from devices and/or agents to which data is transmitted based on other action(s) of the bundle. Implementations determine command bundles that are likely relevant to a user, and present those command bundles as suggestions to the user. In some of those implementations, a machine learning model is utilized to generate a user action embedding for the user, and a command bundle embedding for each of a plurality of command bundles. Command bundle(s) can be selected for suggestion based on comparison of the user action embedding and the command bundle embeddings.
-
公开(公告)号:US20220107725A1
公开(公告)日:2022-04-07
申请号:US17552938
申请日:2021-12-16
Applicant: GOOGLE LLC
Inventor: Yuzhao Ni
IPC: G06F3/04847 , H04N5/232 , G06F3/04883 , G06V20/10
Abstract: Implementations discussed herein relate to systems, methods, and apparatuses for controlling one or more internet of things (IoT) devices via a graphical camera interface of a portable electronic device. The graphical camera interface can be presented at the portable electronic device in response to the user accessing a camera application via the portable electronic device and directing a camera of the portable electronic device at the IoT device. One or more images generated from an output of the camera can be processed to identify the IoT device that the user is intending to control. Information related to a context in which the user aimed their camera at the IoT device can be used to assist in narrowing down a selection of the IoT device from multiple different IoT devices that may be associated with the user and/or an image captured by the camera.
-
公开(公告)号:US11237795B2
公开(公告)日:2022-02-01
申请号:US16610815
申请日:2019-02-01
Applicant: Google LLC
Inventor: Tomer Amarilio , Yuzhao Ni , Bryan Allen , Norbert Tydingco , Will Donnelly , Feng Yuan , Nathaniel Nesiba , Anurag Jain , Jacky Cheung , Ronghui Zhu , Chunya Hua , Gregory Kielian
Abstract: In response to a user interacting with a tangible peripheral assistant control device (e.g., depressing a button of the device), causing an automated assistant to perform one or more actions. The action(s) performed can be based on input previously provided by the user in configuring the peripheral assistant control device. The action(s) performed in response to interaction with the peripheral assistant control device can vary based on one or more conditions, such as which user is currently active, where the peripheral assistant control device is currently located (which can optionally be inferred based on which of multiple assistant computing devices the button is paired with), and/or the current state of one or more smart devices and/or other devices (e.g., as determined based on a device topology). A utility of the peripheral assistant control device can be automatically extended beyond what was specifically requested by a user during configuration.
-
公开(公告)号:US20220014413A1
公开(公告)日:2022-01-13
申请号:US17484202
申请日:2021-09-24
Applicant: Google LLC
Inventor: Yuzhao Ni , Ashwin Limaye , Cindy Tran , Thomas Clifton , David Roy Schairer
Abstract: Implementing methods to provide a shortened textual summary that includes status information that is most pertinent to the user for a plurality of connected smart devices. The method includes determining a list of current statuses for a plurality of enabled smart devices and filtering the list to remove statuses that may not be of interest to the user. The filtering of the list is based on a current context of the requesting user and one or more previous contexts of the user. The resulting filtered statuses are then converted to textual snippets, summarized, and provided to the user via one or more output devices.
-
57.
公开(公告)号:US20210398536A1
公开(公告)日:2021-12-23
申请号:US17466875
申请日:2021-09-03
Applicant: Google LLC
Inventor: Yuzhao Ni
Abstract: Implementations relate to mitigating client device latency in rendering of remotely generated automated assistant content. Some of those implementations mitigate client device latency between rendering of multiple instances of output that are each based on content that is responsive to a corresponding automated assistant action of a multiple action request. For example, those implementations can reduce latency between rendering of first output that is based on first content responsive to a first automated assistant action of a multiple action request, and second output that is based on second content responsive to a second automated assistant action of the multiple action request.
-
58.
公开(公告)号:US11114096B2
公开(公告)日:2021-09-07
申请号:US16341774
申请日:2018-03-23
Applicant: Google LLC
Inventor: Yuzhao Ni
Abstract: Implementations relate to mitigating client device latency in rendering of remotely generated automated assistant content. Some of those implementations mitigate client device latency between rendering of multiple instances of output that are each based on content that is responsive to a corresponding automated assistant action of a multiple action request. For example, those implementations can reduce latency between rendering of first output that is based on first content responsive to a first automated assistant action of a multiple action request, and second output that is based on second content responsive to a second automated assistant action of the multiple action request.
-
公开(公告)号:US20210132559A1
公开(公告)日:2021-05-06
申请号:US16617994
申请日:2019-03-13
Applicant: Google LLC
Inventor: Yuzhao Ni , David Roy Schairer
IPC: G05B19/042 , G06F9/451 , G06F3/0484 , H04L29/08 , H04L12/28
Abstract: Efficient control and/or linking of smart network connected devices. Some implementations are directed to rendering, within an active application that enables control of multiple smart devices from multiple parties, both: (1) an interactive graphical interface element that, when interacted with, causes corresponding control of smart device(s) of a third-party (3P); and (2) a selectable element that, when selected, causes execution of a deeplink to cause a 3P application to open in a state that presents additional information for the smart device(s). Some implementations are additionally or alternatively directed to, in response to determining that a application is installed at a client device, but a smart device topology lacks any entries for 3P smart devices of the 3P, efficiently adding one or more particular smart devices of the 3P to the smart device topology.
-
60.
公开(公告)号:US20200342861A1
公开(公告)日:2020-10-29
申请号:US16480523
申请日:2019-02-01
Applicant: Google LLC
Inventor: Yuzhao Ni , David Roy Schairer
IPC: G10L15/22 , G06F3/0484 , G06F3/0481 , H04L12/28
Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.
-
-
-
-
-
-
-
-
-