-
公开(公告)号:US20230273716A1
公开(公告)日:2023-08-31
申请号:US18142902
申请日:2023-05-03
申请人: GOOGLE LLC
发明人: Yuzhao Ni
IPC分类号: G06F3/04847 , G06F3/04883 , G06V20/10 , H04N23/63
CPC分类号: G06F3/04847 , G06F3/04883 , G06V20/10 , H04N23/631
摘要: Implementations discussed herein relate to systems, methods, and apparatuses for controlling one or more internet of things (IoT) devices via a graphical camera interface of a portable electronic device. The graphical camera interface can be presented at the portable electronic device in response to the user accessing a camera application via the portable electronic device and directing a camera of the portable electronic device at the IoT device. One or more images generated from an output of the camera can be processed to identify the IoT device that the user is intending to control. Information related to a context in which the user aimed their camera at the IoT device can be used to assist in narrowing down a selection of the IoT device from multiple different IoT devices that may be associated with the user and/or an image captured by the camera.
-
2.
公开(公告)号:US20230185429A1
公开(公告)日:2023-06-15
申请号:US18108842
申请日:2023-02-13
申请人: GOOGLE LLC
发明人: Yuzhao Ni , David Roy Schairer
IPC分类号: G06F3/0482 , G06F3/0484 , H04L67/12 , G06F3/04812 , G10L15/22 , H04L12/28
CPC分类号: G06F3/0482 , G06F3/0484 , H04L67/12 , G06F3/04812 , G10L15/22 , H04L12/282 , G10L2015/223
摘要: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated proactively and/or in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.
-
公开(公告)号:US11644964B2
公开(公告)日:2023-05-09
申请号:US17552938
申请日:2021-12-16
申请人: GOOGLE LLC
发明人: Yuzhao Ni
IPC分类号: G06F3/04847 , G06F3/04883 , G06V20/10 , H04N23/63
CPC分类号: G06F3/04847 , G06F3/04883 , G06V20/10 , H04N23/631
摘要: Implementations discussed herein relate to systems, methods, and apparatuses for controlling one or more internet of things (IoT) devices via a graphical camera interface of a portable electronic device. The graphical camera interface can be presented at the portable electronic device in response to the user accessing a camera application via the portable electronic device and directing a camera of the portable electronic device at the IoT device. One or more images generated from an output of the camera can be processed to identify the IoT device that the user is intending to control. Information related to a context in which the user aimed their camera at the IoT device can be used to assist in narrowing down a selection of the IoT device from multiple different IoT devices that may be associated with the user and/or an image captured by the camera.
-
公开(公告)号:US11450314B2
公开(公告)日:2022-09-20
申请号:US15785100
申请日:2017-10-16
申请人: Google LLC
发明人: Yuzhao Ni , Lucas Palmer
摘要: Methods, apparatus, systems, and computer-readable media are provided for using shortcut command phrases to operate an automated assistant. A user of the automated assistant can request that a shortcut command phrase be established for causing the automated assistant to perform a variety of different actions. In this way, the user does not necessarily have to provide an individual command for each action to be performed but, rather, can use a shortcut command phrase to cause the automated assistant to perform the actions. The shortcut command phrases can be used to control peripheral devices, IoT devices, applications, websites, and/or any other apparatuses or processes capable of being controlled through an automated assistant.
-
公开(公告)号:US11275553B2
公开(公告)日:2022-03-15
申请号:US16610815
申请日:2019-02-01
申请人: Google LLC
发明人: Tomer Amarilio , Yuzhao Ni , Bryan Allen , Norbert Tydingco , Will Donnelly , Feng Yuan , Nathaniel Nesiba , Anurag Jain , Jacky Cheung , Ronghui Zhu , Chunya Hua , Gregory Kielian
摘要: In response to a user interacting with a tangible peripheral assistant control device (e.g., depressing a button of the device), causing an automated assistant to perform one or more actions. The action(s) performed can be based on input previously provided by the user in configuring the peripheral assistant control device. The action(s) performed in response to interaction with the peripheral assistant control device can vary based on one or more conditions, such as which user is currently active, where the peripheral assistant control device is currently located (which can optionally be inferred based on which of multiple assistant computing devices the button is paired with), and/or the current state of one or more smart devices and/or other devices (e.g., as determined based on a device topology). A utility of the peripheral assistant control device can be automatically extended beyond what was specifically requested by a user during configuration.
-
6.
公开(公告)号:US20220013121A1
公开(公告)日:2022-01-13
申请号:US17484184
申请日:2021-09-24
申请人: Google LLC
发明人: Yuzhao Ni
摘要: Transferring (e.g., automatically) an automated assistant routine between client devices during execution of the automated assistant routine. The automated assistant routine can correspond to a set of actions to be performed by one or more agents and/or one or more devices. While content, corresponding to an action of the routine, is being rendered at a particular device, the user may walk away from the particular device and toward a separate device. The automated assistant routine can be automatically transferred in response, and the separate device can continue to rendering the content for the user.
-
7.
公开(公告)号:US11133003B2
公开(公告)日:2021-09-28
申请号:US16349889
申请日:2018-04-23
申请人: Google LLC
发明人: Yuzhao Ni
摘要: Transferring (e.g., automatically) an automated assistant routine between client devices during execution of the automated assistant routine. The automated assistant routine can correspond to a set of actions to be performed by one or more agents and/or one or more devices. While content, corresponding to an action of the routine, is being rendered at a particular device, the user may walk away from the particular device and toward a separate device. The automated assistant routine can be automatically transferred in response, and the separate device can continue to rendering the content for the user.
-
公开(公告)号:US10891957B2
公开(公告)日:2021-01-12
申请号:US16594807
申请日:2019-10-07
申请人: Google LLC
发明人: Yuzhao Ni , David Roy Schairer
摘要: In one example, a method includes receiving audio data generated by one or more microphones of a computing device, the audio data representing a spoken utterance; identifying, based on the audio data, a user that provided the spoken utterance; identifying, based on the audio data, an automation action associated with one or more automation devices, the automation action corresponding to the spoken utterance; determining whether the identified user is authorized to cause performance of the identified automation action; and responsive to determining that the identified user is authorized to cause performance of the identified automation action, causing the one or more automation devices to perform the identified automation action.
-
9.
公开(公告)号:US20240144927A1
公开(公告)日:2024-05-02
申请号:US18406522
申请日:2024-01-08
申请人: GOOGLE LLC
发明人: Yuzhao Ni
摘要: Implementations relate to mitigating client device latency in rendering of remotely generated automated assistant content. Some of those implementations mitigate client device latency between rendering of multiple instances of output that are each based on content that is responsive to a corresponding automated assistant action of a multiple action request. For example, those implementations can reduce latency between rendering of first output that is based on first content responsive to a first automated assistant action of a multiple action request, and second output that is based on second content responsive to a second automated assistant action of the multiple action request.
-
公开(公告)号:US11893309B2
公开(公告)日:2024-02-06
申请号:US17691889
申请日:2022-03-10
申请人: GOOGLE LLC
发明人: Tomer Amarilio , Yuzhao Ni , Bryan Allen , Norbert Tydingco , Will Donnelly , Feng Yuan , Nathaniel Nesiba , Anurag Jain , Jacky Cheung , Ronghui Zhu , Chunya Hua , Gregory Kielian
CPC分类号: G06F3/167 , G10L15/08 , G10L15/22 , G06F2221/2111 , G10L2015/223
摘要: In response to a user interacting with a tangible peripheral assistant control device (e.g., depressing a button of the device), causing an automated assistant to perform one or more actions. The action(s) performed can be based on input previously provided by the user in configuring the peripheral assistant control device. The action(s) performed in response to interaction with the peripheral assistant control device can vary based on one or more conditions, such as which user is currently active, where the peripheral assistant control device is currently located (which can optionally be inferred based on which of multiple assistant computing devices the button is paired with), and/or the current state of one or more smart devices and/or other devices (e.g., as determined based on a device topology). A utility of the peripheral assistant control device can be automatically extended beyond what was specifically requested by a user during configuration.
-
-
-
-
-
-
-
-
-