公开(公告)号：US12081830B2

公开(公告)日：2024-09-03

申请号：US18351370

申请日：2023-07-12

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: G10L17/22 ,  G06Q10/109 ,  H04L12/28 ,  H04L67/62 ,  H04N21/234 ,  H04N21/258 ,  H04N21/4223 ,  H04N21/436

CPC classification number: H04N21/43615 ,  G06Q10/109 ,  G10L17/22 ,  H04L12/2803 ,  H04L12/281 ,  H04L12/282 ,  H04L67/62 ,  H04N21/23418 ,  H04N21/25875 ,  H04N21/4223

Abstract: Various arrangements are detailed herein related to managing video recording based on spoken commands. A system receives a video stream from a video camera and analyzes a field of view in the received video stream to determine a location for one or more identified or potential users. The system can beamform audio from microphones of a home assistant device based on the location of the one or more identified or potential users. The system adjusts an audio output based on the location of the one or more identified or potential users, receives a spoken command from the one or more identified or potential users, and outputs a response to the spoken command.

公开(公告)号：US20190124393A1

公开(公告)日：2019-04-25

申请号：US16230349

申请日：2018-12-21

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04L29/08 ,  H04L12/28 ,  G10L17/22

Abstract: Various arrangements are detailed herein related to modifying a shopping list using a home assistant device and an integrated video service. A network-enabled video camera may be used to capture a video stream of a location at which a user is present. A home assistant device may receive a spoken command that requests an item be added to a shopping list. The video stream captured using the network-enabled video camera may be analyzed to determine an identity of the user. A shopping list to modify may be determined based on the identity of the user. The determined shopping list may then be modified to indicate the item requested in the spoken command.

公开(公告)号：US11303955B2

公开(公告)日：2022-04-12

申请号：US16877847

申请日：2020-05-19

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04L12/28 ,  H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  G10L17/22 ,  H04L67/62

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

公开(公告)号：US20230362434A1

公开(公告)日：2023-11-09

申请号：US18351370

申请日：2023-07-12

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  G06Q10/109 ,  H04N21/258 ,  H04N21/234 ,  G10L17/22 ,  H04N21/4223 ,  H04L67/62 ,  H04L12/28

CPC classification number: H04N21/43615 ,  G06Q10/109 ,  G10L17/22 ,  H04L12/2803 ,  H04L12/281 ,  H04L12/282 ,  H04L67/62 ,  H04N21/23418 ,  H04N21/25875 ,  H04N21/4223

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

公开(公告)号：US11736760B2

公开(公告)日：2023-08-22

申请号：US17656788

申请日：2022-03-28

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/109 ,  H04N21/258 ,  H04L67/62 ,  G10L17/22 ,  H04L12/28

CPC classification number: H04N21/43615 ,  G06Q10/109 ,  G10L17/22 ,  H04L12/281 ,  H04L12/282 ,  H04L12/2803 ,  H04L67/62 ,  H04N21/23418 ,  H04N21/25875 ,  H04N21/4223

Abstract: Methods, devices, systems, and means for video integration with a home assistant device are described herein. The home assistant device interacts with a person in a video stream by capturing, using a network-enabled outdoor video camera, a video stream of an outdoor location of a premises at which the person is present and analyzing the person appearing in the captured video stream to determine an identity of the person. Based on determining the identity of the person, the home assistant device announces a presence of the person that is outdoors and outputs instructions to the person.

公开(公告)号：US20220217439A1

公开(公告)日：2022-07-07

申请号：US17656788

申请日：2022-03-28

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  G10L17/22 ,  H04L12/28 ,  H04L67/62

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

公开(公告)号：US20200280763A1

公开(公告)日：2020-09-03

申请号：US16877847

申请日：2020-05-19

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  G10L17/22 ,  H04L12/28 ,  H04L29/08

Abstract: Various arrangements are detailed herein related to managing video recording. A system can include a network-enabled video camera that captures a video stream of a location and streams the video stream to a cloud-based home assistant integration platform. The system can include a home assistant device comprising a microphone and wireless network interface, the home assistant device configured to receive, via the microphone, a spoken command that requests video, captured by the network-enabled video camera, be recorded. The cloud-based home assistant integration platform may be configured to analyze the video stream captured using the network-enabled video camera to determine an identity of the user. The platform may be further configured to store a portion of the video stream linked to a user account of the user based on the spoken command and the identity of the user.

公开(公告)号：US10687109B2

公开(公告)日：2020-06-16

申请号：US16230349

申请日：2018-12-21

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: G10L17/22 ,  H04N21/436 ,  H04N21/234 ,  H04N21/4223 ,  G06Q10/10 ,  H04N21/258 ,  H04L12/28 ,  H04L29/08

Abstract: Various arrangements are detailed herein related to modifying a shopping list using a home assistant device and an integrated video service. A network-enabled video camera may be used to capture a video stream of a location at which a user is present. A home assistant device may receive a spoken command that requests an item be added to a shopping list. The video stream captured using the network-enabled video camera may be analyzed to determine an identity of the user. A shopping list to modify may be determined based on the identity of the user. The determined shopping list may then be modified to indicate the item requested in the spoken command.

公开(公告)号：US10200746B1

公开(公告)日：2019-02-05

申请号：US15654491

申请日：2017-07-19

Applicant: Google LLC

Inventor： Jessica Yuan ,  James Stewart ,  Rajeev Nongpiur ,  Patrick Lister ,  Chi Yeung Jonathan Ng

IPC: H04N21/436 ,  G10L17/22 ,  H04L12/28 ,  H04L29/08

Abstract: Various arrangements are detailed herein related to managing scheduled events using a home assistant and an integrated video service. Using a network-enabled video camera, a video stream of a location may be captured. The video stream captured may be used to determine an identity of a user present at the location. In response to identifying the identity of the user, access to a cloud-based calendar account for the user may be determined to be authorized. The cloud-based calendar account linked with the user may be accessed. A next calendar event mapped to the cloud-based calendar account that is scheduled to occur within a threshold time duration may be determined. A description linked with the next calendar event may be accessed. A network-enabled smart home assistant device may be used to synthesize speech to announce details related to the next event.