公开(公告)号：US11948574B2

公开(公告)日：2024-04-02

申请号：US18085867

申请日：2022-12-21

Applicant: GOOGLE LLC

Inventor： David Roy Schairer ,  Sumer Mohammed ,  Mark Spates, IV ,  Prem Kumar ,  Chi Yeung Jonathan Ng ,  Di Zhu ,  Steven Clark

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/08 ,  G10L15/30 ,  G16Y40/10 ,  G16Y40/35 ,  H04L12/28 ,  H04W4/70

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L15/08 ,  G10L15/30 ,  G16Y40/10 ,  G16Y40/35 ,  H04L12/282 ,  H04W4/70 ,  G10L2015/088 ,  G10L2015/223

Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification. The remote automated assistant component(s) can then transmit a corresponding command to each of the assistant client device(s) it determines should render a corresponding client device notification, where each transmitted command causes the corresponding assistant client device to render the corresponding client device notification.

公开(公告)号：US20230185429A1

公开(公告)日：2023-06-15

申请号：US18108842

申请日：2023-02-13

Applicant: GOOGLE LLC

Inventor： Yuzhao Ni ,  David Roy Schairer

IPC: G06F3/0482 ,  G06F3/0484 ,  H04L67/12 ,  G06F3/04812 ,  G10L15/22 ,  H04L12/28

CPC classification number: G06F3/0482 ,  G06F3/0484 ,  H04L67/12 ,  G06F3/04812 ,  G10L15/22 ,  H04L12/282 ,  G10L2015/223

Abstract: Methods, apparatus, systems, and computer-readable media are provided for tailoring composite graphical assistant interfaces for interacting with multiple different connected devices. The composite graphical assistant interfaces can be generated proactively and/or in response to a user providing a request for an automated assistant to cause a connected device to perform a particular function. In response to the automated assistant receiving the request, the automated assistant can identify other connected devices, and other functions capable of being performed by the other connected devices. The other functions can then be mapped to various graphical control elements in order to provide a composite graphical assistant interface from which the user can interact with different connected devices. Each graphical control element can be arranged to reflect how each connected device is operating simultaneous to the presentation of the composite graphical assistant interface.

公开(公告)号：US10891957B2

公开(公告)日：2021-01-12

申请号：US16594807

申请日：2019-10-07

Applicant: Google LLC

Inventor： Yuzhao Ni ,  David Roy Schairer

IPC: G10L15/00 ,  G10L15/22 ,  G10L15/08 ,  G10L17/22 ,  G06F21/32 ,  H04L29/06

Abstract: In one example, a method includes receiving audio data generated by one or more microphones of a computing device, the audio data representing a spoken utterance; identifying, based on the audio data, a user that provided the spoken utterance; identifying, based on the audio data, an automation action associated with one or more automation devices, the automation action corresponding to the spoken utterance; determining whether the identified user is authorized to cause performance of the identified automation action; and responsive to determining that the identified user is authorized to cause performance of the identified automation action, causing the one or more automation devices to perform the identified automation action.

公开(公告)号：US10885917B2

公开(公告)日：2021-01-05

申请号：US16609015

申请日：2019-03-13

Applicant: Google LLC

Inventor： David Roy Schairer ,  Sumer Mohammed ,  Mark Spates, IV ,  Prem Kumar ,  Chi Yeung Jonathan Ng ,  Di Zhu ,  Steven Clark

IPC: G10L15/22 ,  H04W4/70 ,  G16Y40/10 ,  G16Y40/35 ,  G10L15/08 ,  G10L15/30 ,  H04L12/28 ,  G06F3/16

Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification. The remote automated assistant component(s) can then transmit a corresponding command to each of the assistant client device(s) it determines should render a corresponding client device notification, where each transmitted command causes the corresponding assistant client device to render the corresponding client device notification.

公开(公告)号：US20200286482A1

公开(公告)日：2020-09-10

申请号：US16880567

申请日：2020-05-21

Applicant: Google LLC

Inventor： Barnaby John James ,  David Roy Schairer ,  Amy Lynn Baldwin ,  Vincent Yanton Mo ,  Jun Yang ,  Mark Spates, IV ,  Lei Zhong

IPC: G10L15/22 ,  G10L15/183 ,  G10L15/30 ,  H04L12/28 ,  H04L12/24

Abstract: Example aspects of the present disclosure are directed to processing voice commands or utterances. For instance, data indicative of a voice utterance can be received. A device topology representation can be accessed. The device topology representation can define a plurality of smart devices associated with one or more structures. The device topology representation can further define a location of each of the plurality of devices within the associated structures. A transcription of the voice utterance can be determined based at least in part on the device topology representation. One or more selected devices and one or more actions to be performed by the one or more selected devices can be determined based at least in part on the determined transcription and the device topology representation.

公开(公告)号：US12154567B2

公开(公告)日：2024-11-26

申请号：US18127454

申请日：2023-03-28

Applicant: GOOGLE LLC

Inventor： Haris Ramic ,  Vikram Aggarwal ,  Moises Morgenstern Gali ,  David Roy Schairer ,  Yao Chen

IPC: G10L15/22 ,  B60W50/08 ,  G06F3/16 ,  G10L15/26

Abstract: The present disclosure is generally related to a data processing system to validate vehicular functions in a voice activated computer network environment. The data processing system can improve the efficiency of the network by discarding action data structures and requests that invalid prior to their transmission across the network. The system can invalidate requests by comparing attributes of a vehicular state to attributes of a request state.

公开(公告)号：US12063317B2

公开(公告)日：2024-08-13

申请号：US17484202

申请日：2021-09-24

Applicant: Google LLC

Inventor： Yuzhao Ni ,  Ashwin Limaye ,  Cindy Tran ,  Thomas Clifton ,  David Roy Schairer

IPC: H04L67/12 ,  G10L15/22 ,  G16Y10/80 ,  G16Y20/20 ,  G16Y20/40 ,  G16Y40/10 ,  G16Y40/35 ,  H04L9/40

CPC classification number: H04L9/40 ,  G10L15/22 ,  G16Y10/80 ,  G16Y20/20 ,  G16Y20/40 ,  G16Y40/10 ,  G16Y40/35 ,  H04L67/12

Abstract: Implementing methods to provide a shortened textual summary that includes status information that is most pertinent to the user for a plurality of connected smart devices. The method includes determining a list of current statuses for a plurality of enabled smart devices and filtering the list to remove statuses that may not be of interest to the user. The filtering of the list is based on a current context of the requesting user and one or more previous contexts of the user. The resulting filtered statuses are then converted to textual snippets, summarized, and provided to the user via one or more output devices.

公开(公告)号：US20240249722A1

公开(公告)日：2024-07-25

申请号：US18623888

申请日：2024-04-01

Applicant: GOOGLE LLC

Inventor： David Roy Schairer ,  Sumer Mohammed ,  Mark Spates, IV ,  Prem Kumar ,  Chi Yeung Jonathan Ng ,  Di Zhu ,  Steven Clark

IPC: G10L15/22 ,  G06F3/16 ,  G10L15/08 ,  G10L15/30 ,  G16Y40/10 ,  G16Y40/35 ,  H04L12/28 ,  H04W4/70

CPC classification number: G10L15/22 ,  G06F3/167 ,  G10L15/08 ,  G10L15/30 ,  G16Y40/10 ,  G16Y40/35 ,  H04L12/282 ,  H04W4/70 ,  G10L2015/088 ,  G10L2015/223

Abstract: Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification. The remote automated assistant component(s) can then transmit a corresponding command to each of the assistant client device(s) it determines should render a corresponding client device notification, where each transmitted command causes the corresponding assistant client device to render the corresponding client device notification.

公开(公告)号：US11817092B2

公开(公告)日：2023-11-14

申请号：US17109347

申请日：2020-12-02

Applicant: Google LLC

Inventor： Yuzhao Ni ,  David Roy Schairer

IPC: G10L15/00 ,  G10L15/22 ,  G10L15/08 ,  G10L17/22 ,  G06F21/32 ,  H04L9/40

CPC classification number: G10L15/22 ,  G06F21/32 ,  G10L15/08 ,  G10L17/22 ,  H04L63/0861 ,  H04L63/102 ,  G10L2015/088 ,  G10L2015/223

Abstract: In one example, a method includes receiving audio data generated by one or more microphones of a computing device, the audio data representing a spoken utterance; identifying, based on the audio data, a user that provided the spoken utterance; identifying, based on the audio data, an automation action associated with one or more automation devices, the automation action corresponding to the spoken utterance; determining whether the identified user is authorized to cause performance of the identified automation action; and responsive to determining that the identified user is authorized to cause performance of the identified automation action, causing the one or more automation devices to perform the identified automation action.

公开(公告)号：US20230353412A1

公开(公告)日：2023-11-02

申请号：US18349660

申请日：2023-07-10

Applicant: GOOGLE LLC

Inventor： Vincent Mo ,  Kyle Lund ,  Manit Limlamai ,  Stephen Lanham ,  Jun Yang ,  Matthew Swartwout ,  Mark Spates, IV ,  David Roy Schairer ,  Gaurav Nolkha

IPC: H04W4/80 ,  G06F3/0488 ,  H04W24/08 ,  H04L12/28 ,  H04B17/318

CPC classification number: H04L12/282 ,  G06F3/0488 ,  H04B17/318 ,  H04L12/2816 ,  H04W4/80 ,  H04W24/08 ,  G16Y10/80

Abstract: Various implementations relate to generating, locally at an assistant client device, specific control commands that, when transmitted to a corresponding smart device, are directly interpretable by the corresponding smart device to effectuate a state change at the corresponding smart device, or at a corresponding additional smart device directly controlled by the corresponding smart device. Various implementations additionally or alternatively relate to utilizing local assistant client devices in discovering, provisioning, and/or registering smart devices for an account of a user.