公开(公告)号：US12081830B2

公开(公告)日：2024-09-03

申请号：US18351370

申请日：2023-07-12

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: G10L17/22 ,  G06Q10/109 ,  H04L12/28 ,  H04L67/62 ,  H04N21/234 ,  H04N21/258 ,  H04N21/4223 ,  H04N21/436

CPC classification number: H04N21/43615 ,  G06Q10/109 ,  G10L17/22 ,  H04L12/2803 ,  H04L12/281 ,  H04L12/282 ,  H04L67/62 ,  H04N21/23418 ,  H04N21/25875 ,  H04N21/4223

Abstract: Various arrangements are detailed herein related to managing video recording based on spoken commands. A system receives a video stream from a video camera and analyzes a field of view in the received video stream to determine a location for one or more identified or potential users. The system can beamform audio from microphones of a home assistant device based on the location of the one or more identified or potential users. The system adjusts an audio output based on the location of the one or more identified or potential users, receives a spoken command from the one or more identified or potential users, and outputs a response to the spoken command.

公开(公告)号：US20190124393A1

公开(公告)日：2019-04-25

申请号：US16230349

申请日：2018-12-21

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04L29/08 ,  H04L12/28 ,  G10L17/22

Abstract: Various arrangements are detailed herein related to modifying a shopping list using a home assistant device and an integrated video service. A network-enabled video camera may be used to capture a video stream of a location at which a user is present. A home assistant device may receive a spoken command that requests an item be added to a shopping list. The video stream captured using the network-enabled video camera may be analyzed to determine an identity of the user. A shopping list to modify may be determined based on the identity of the user. The determined shopping list may then be modified to indicate the item requested in the spoken command.

公开(公告)号：US11303955B2

公开(公告)日：2022-04-12

申请号：US16877847

申请日：2020-05-19

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04L12/28 ,  H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  G10L17/22 ,  H04L67/62

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

公开(公告)号：US20220329762A1

公开(公告)日：2022-10-13

申请号：US17662912

申请日：2022-05-11

Applicant: Google LLC

Inventor： Courtney Dattilo-Green ,  Zachery Webster Kennedy ,  Anthony M. Fadell ,  Patrick Lister ,  Michael Mizono

IPC: H04N7/18 ,  H04L67/025 ,  H04L41/22 ,  H04L67/12

Abstract: The various embodiments described herein include methods, devices, and systems for presenting smart home information. In one aspect, a method includes: (1) determining that a first set of smart devices correspond to a first space of a plurality of spaces of a dwelling; (2) displaying a first user interface including: (a) displaying a first interface section corresponding to the first space; and (b) displaying, within the first interface section, a plurality of user interface objects corresponding to the first set of smart devices, where each user interface object of the plurality of user interface objects corresponds to a respective smart device of the first set of smart devices; (3) detecting a user selection of a particular user interface object; and (4) in response to detecting the user selection of the particular user interface object, displaying a second user interface that includes additional information regarding the corresponding smart device.

公开(公告)号：US09911319B2

公开(公告)日：2018-03-06

申请号：US15331475

申请日：2016-10-21

Applicant: Google LLC

Inventor： Mark Rajan Malhotra ,  Jeffrey Alan Boyd ,  Sophie Le Guen ,  Jeffery Theodore Lee ,  Prashant Reddy ,  Patrick Lister ,  Jesse Boettcher ,  Josh Buffum

IPC: G08B29/18 ,  G08B25/00 ,  G08B21/04

CPC classification number: G08B29/185 ,  G08B19/00 ,  G08B21/0423 ,  G08B25/008

Abstract: Systems and techniques are provided for automatic security system mode selection. A set of signals may be received from sensors distributed in an environment with a security system. The security system may be in a first mode. An occupancy model may be received. An occupancy estimate may be generated for the environment based on the set of signals from the sensors and the occupancy model. Mode rules may be received. The mode rules associate occupancy estimates with modes of the security system. A second mode for the security system may be determined based on the occupancy estimate and mode rules. The second mode may be different from the first mode. The mode of the security system may be automatically changed from the first mode to the second mode.

公开(公告)号：US20230362434A1

公开(公告)日：2023-11-09

申请号：US18351370

申请日：2023-07-12

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  G06Q10/109 ,  H04N21/258 ,  H04N21/234 ,  G10L17/22 ,  H04N21/4223 ,  H04L67/62 ,  H04L12/28

CPC classification number: H04N21/43615 ,  G06Q10/109 ,  G10L17/22 ,  H04L12/2803 ,  H04L12/281 ,  H04L12/282 ,  H04L67/62 ,  H04N21/23418 ,  H04N21/25875 ,  H04N21/4223

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

公开(公告)号：US11736760B2

公开(公告)日：2023-08-22

申请号：US17656788

申请日：2022-03-28

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/109 ,  H04N21/258 ,  H04L67/62 ,  G10L17/22 ,  H04L12/28

CPC classification number: H04N21/43615 ,  G06Q10/109 ,  G10L17/22 ,  H04L12/281 ,  H04L12/282 ,  H04L12/2803 ,  H04L67/62 ,  H04N21/23418 ,  H04N21/25875 ,  H04N21/4223

Abstract: Methods, devices, systems, and means for video integration with a home assistant device are described herein. The home assistant device interacts with a person in a video stream by capturing, using a network-enabled outdoor video camera, a video stream of an outdoor location of a premises at which the person is present and analyzing the person appearing in the captured video stream to determine an identity of the person. Based on determining the identity of the person, the home assistant device announces a presence of the person that is outdoors and outputs instructions to the person.

公开(公告)号：US20220217439A1

公开(公告)日：2022-07-07

申请号：US17656788

申请日：2022-03-28

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  G10L17/22 ,  H04L12/28 ,  H04L67/62

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

公开(公告)号：US20200280763A1

公开(公告)日：2020-09-03

申请号：US16877847

申请日：2020-05-19

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  G10L17/22 ,  H04L12/28 ,  H04L29/08

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

公开(公告)号：US10687109B2

公开(公告)日：2020-06-16

申请号：US16230349

申请日：2018-12-21

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: G10L17/22 ,  H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  H04L12/28 ,  H04L29/08

Abstract: Various arrangements are detailed herein related to modifying a shopping list using a home assistant device and an integrated video service. A network-enabled video camera may be used to capture a video stream of a location at which a user is present. A home assistant device may receive a spoken command that requests an item be added to a shopping list. The video stream captured using the network-enabled video camera may be analyzed to determine an identity of the user. A shopping list to modify may be determined based on the identity of the user. The determined shopping list may then be modified to indicate the item requested in the spoken command.