PROVIDING COMPOSITE GRAPHICAL ASSISTANT INTERFACES FOR CONTROLLING VARIOUS CONNECTED DEVICES

    公开(公告)号:US20220187960A1

    公开(公告)日:2022-06-16

    申请号:US17676624

    申请日:2022-02-21

    Applicant: GOOGLE LLC

    Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.

    EFFICIENT CONTROL AND/OR LINKING OF SMART DEVICES

    公开(公告)号:US20220187778A1

    公开(公告)日:2022-06-16

    申请号:US17688583

    申请日:2022-03-07

    Applicant: GOOGLE LLC

    Abstract: Efficient control and/or linking of smart network connected devices. Some implementations are directed to rendering, within an active application that enables control of multiple smart devices from multiple parties, both: (1) an interactive graphical interface element that, when interacted with, causes corresponding control of smart device(s) of a third-party (3P); and (2) a selectable element that, when selected, causes execution of a deeplink to cause a 3P application to open in a state that presents additional information for the smart device(s). Some implementations are additionally or alternatively directed to, in response to determining that a 3P application is installed at a client device, but a smart device topology lacks any entries for 3P smart devices of the 3P, efficiently adding one or more particular smart devices of the 3P to the smart device topology.

    PROVIDING COMMAND BUNDLE SUGGESTIONS FOR AN AUTOMATED ASSISTANT

    公开(公告)号:US20220148595A1

    公开(公告)日:2022-05-12

    申请号:US17582847

    申请日:2022-01-24

    Applicant: Google LLC

    Inventor: Yuzhao Ni

    Abstract: Generating and/or recommending command bundles for a user of an automated assistant. A command bundle comprises a plurality of discrete actions that can be performed by an automated assistant. One or more of the actions of a command bundle can cause transmission of a corresponding command and/or other data to one or more devices and/or agents that are distinct from devices and/or agents to which data is transmitted based on other action(s) of the bundle. Implementations determine command bundles that are likely relevant to a user, and present those command bundles as suggestions to the user. In some of those implementations, a machine learning model is utilized to generate a user action embedding for the user, and a command bundle embedding for each of a plurality of command bundles. Command bundle(s) can be selected for suggestion based on comparison of the user action embedding and the command bundle embeddings.

    CONTROLLING A DEVICE BASED ON PROCESSING OF IMAGE DATA THAT CAPTURES THE DEVICE AND/OR AN INSTALLATION ENVIRONMENT OF THE DEVICE

    公开(公告)号:US20220107725A1

    公开(公告)日:2022-04-07

    申请号:US17552938

    申请日:2021-12-16

    Applicant: GOOGLE LLC

    Inventor: Yuzhao Ni

    Abstract: Implementations discussed herein relate to systems, methods, and apparatuses for controlling one or more internet of things (IoT) devices via a graphical camera interface of a portable electronic device. The graphical camera interface can be presented at the portable electronic device in response to the user accessing a camera application via the portable electronic device and directing a camera of the portable electronic device at the IoT device. One or more images generated from an output of the camera can be processed to identify the IoT device that the user is intending to control. Information related to a context in which the user aimed their camera at the IoT device can be used to assist in narrowing down a selection of the IoT device from multiple different IoT devices that may be associated with the user and/or an image captured by the camera.

    MITIGATION OF CLIENT DEVICE LATENCY IN RENDERING OF REMOTELY GENERATED AUTOMATED ASSISTANT CONTENT

    公开(公告)号:US20210398536A1

    公开(公告)日:2021-12-23

    申请号:US17466875

    申请日:2021-09-03

    Applicant: Google LLC

    Inventor: Yuzhao Ni

    Abstract: Implementations relate to mitigating client device latency in rendering of remotely generated automated assistant content. Some of those implementations mitigate client device latency between rendering of multiple instances of output that are each based on content that is responsive to a corresponding automated assistant action of a multiple action request. For example, those implementations can reduce latency between rendering of first output that is based on first content responsive to a first automated assistant action of a multiple action request, and second output that is based on second content responsive to a second automated assistant action of the multiple action request.

    Mitigation of client device latency in rendering of remotely generated automated assistant content

    公开(公告)号:US11114096B2

    公开(公告)日:2021-09-07

    申请号:US16341774

    申请日:2018-03-23

    Applicant: Google LLC

    Inventor: Yuzhao Ni

    Abstract: Implementations relate to mitigating client device latency in rendering of remotely generated automated assistant content. Some of those implementations mitigate client device latency between rendering of multiple instances of output that are each based on content that is responsive to a corresponding automated assistant action of a multiple action request. For example, those implementations can reduce latency between rendering of first output that is based on first content responsive to a first automated assistant action of a multiple action request, and second output that is based on second content responsive to a second automated assistant action of the multiple action request.

    EFFICIENT CONTROL AND/OR LINKING OF SMART DEVICES

    公开(公告)号:US20210132559A1

    公开(公告)日:2021-05-06

    申请号:US16617994

    申请日:2019-03-13

    Applicant: Google LLC

    Abstract: Efficient control and/or linking of smart network connected devices. Some implementations are directed to rendering, within an active application that enables control of multiple smart devices from multiple parties, both: (1) an interactive graphical interface element that, when interacted with, causes corresponding control of smart device(s) of a third-party (3P); and (2) a selectable element that, when selected, causes execution of a deeplink to cause a 3P application to open in a state that presents additional information for the smart device(s). Some implementations are additionally or alternatively directed to, in response to determining that a application is installed at a client device, but a smart device topology lacks any entries for 3P smart devices of the 3P, efficiently adding one or more particular smart devices of the 3P to the smart device topology.

    PROVIDING COMPOSITE GRAPHICAL ASSISTANT INTERFACES FOR CONTROLLING VARIOUS CONNECTED DEVICES

    公开(公告)号:US20200342861A1

    公开(公告)日:2020-10-29

    申请号:US16480523

    申请日:2019-02-01

    Applicant: Google LLC

    Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.

Patent Agency Ranking