公开(公告)号：US20240265731A1

公开(公告)日：2024-08-08

申请号：US18040241

申请日：2022-08-01

Applicant: Google LLC

Inventor： Mohammad Afshar ,  Saajan Shridhar ,  George Alban Heitz, III ,  Andrew C. Gallagher ,  Michael C. Nechyba ,  Joseph E. Roth

IPC: G06V40/16 ,  G06V10/762 ,  G06V10/94

CPC classification number: G06V40/172 ,  G06V10/762 ,  G06V10/95

Abstract: The present document describes systems and methods for on-device person recognition and provision of intelligent alerts. The system includes a decentralized multi-camera system for on-device facial recognition. A device (e.g., security camera, video doorbell) captures images/video of a person, processes input image frames, detects face images, filters static faces, and aligns a rotation of the face to be upright and frontal. The device then filters low-quality face images and/or images having a large portion of the face occluded. The device computes a face embedding, compares it against a set of locally stored reference embeddings, and sends matching results to cloud services, which, based on the matching result, notifies the device owner whether the observed person is a known person or a stranger. Face detection and recognition computations are performed on device, not at the cloud. No sensitive information is transmitted off device and privacy is thus preserved.

公开(公告)号：US11240560B2

公开(公告)日：2022-02-01

申请号：US16973370

申请日：2020-05-06

Applicant: GOOGLE LLC

Inventor： Jaclyn Konzelmann ,  Tuan Nguyen ,  Vinay Bettadapura ,  Andrew C. Gallagher ,  Utsav Prabhu ,  Caroline Pantofaru

IPC: H04N21/44 ,  H04N21/442 ,  G06T7/70 ,  H04N21/258 ,  H04N21/41

Abstract: Implementations relate to an automated assistant that provides and manages output from one or more elements of output hardware of a computing device. The automated assistant manages dynamic adjustment of access permissions to the computing device according to, for example, a detected presence of one or more users. An active-user queue can be established each time a unique user enters a viewing window of a camera of the computing device when, up to that point, no user was considered active. Multiple image frames can be captured via the camera and processed to determine whether an initial user remains in the viewing window and/or whether another user has entered the viewing window. The initial user can be considered active as long as they are exclusively detected in the viewing window. Restricted content associated with the user may be rendered by the computing device whilst the user is active.

公开(公告)号：US20210258641A1

公开(公告)日：2021-08-19

申请号：US16973370

申请日：2020-05-06

Applicant: GOOGLE LLC

Inventor： Jaclyn Konzelmann ,  Tuan Nguyen ,  Vinay Bettadapura ,  Andrew C. Gallagher ,  Utsav Prabhu ,  Caroline Pantofaru

IPC: H04N21/442 ,  H04N21/258 ,  H04N21/41 ,  G06T7/70

Abstract: Implementations relate to an automated assistant that provides and manages output from one or more elements of output hardware of a computing device. The automated assistant manages dynamic adjustment of access permissions to the computing device according to, for example, a detected presence of one or more users. An active-user queue can be established each time a unique user enters a viewing window of a camera of the computing device when, up to that point, no user was considered active. Multiple image frames can be captured via the camera and processed to determine whether an initial user remains in the viewing window and/or whether another user has entered the viewing window. The initial user can be considered active as long as they are exclusively detected in the viewing window. Restricted content associated with the user may be rendered by the computing device whilst the user is active.

公开(公告)号：US20190147105A1

公开(公告)日：2019-05-16

申请号：US15813978

申请日：2017-11-15

Applicant: Google LLC

Inventor： Hang Chu ,  Michael Nechyba ,  Andrew C. Gallagher ,  Utsav Prabhu

IPC: G06F17/30 ,  G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for partitioning videos. In one aspect, a method includes obtaining a partition of a video into one or more shots. Features are generated for each shot, including visual features and audio features. The generated features for each shot are provided as input to a partitioning neural network that is configured to process the generated features to generate a partitioning neural network output. The partition of the video into one or more chapters is determined based on the partitioning neural network output, where a chapter is a sequence of consecutive shots that are determined to be taken at one or more locations that are semantically related.