Invention Publication
- Patent Title: Systems and Methods for On-Device Person Recognition and Provision of Intelligent Alerts
-
Application No.: US18040241Application Date: 2022-08-01
-
Publication No.: US20240265731A1Publication Date: 2024-08-08
- Inventor: Mohammad Afshar , Saajan Shridhar , George Alban Heitz, III , Andrew C. Gallagher , Michael C. Nechyba , Joseph E. Roth
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- International Application: PCT/US2022/074367 2022.08.01
- Date entered country: 2023-02-01
- Main IPC: G06V40/16
- IPC: G06V40/16 ; G06V10/762 ; G06V10/94

Abstract:
The present document describes systems and methods for on-device person recognition and provision of intelligent alerts. The system includes a decentralized multi-camera system for on-device facial recognition. A device (e.g., security camera, video doorbell) captures images/video of a person, processes input image frames, detects face images, filters static faces, and aligns a rotation of the face to be upright and frontal. The device then filters low-quality face images and/or images having a large portion of the face occluded. The device computes a face embedding, compares it against a set of locally stored reference embeddings, and sends matching results to cloud services, which, based on the matching result, notifies the device owner whether the observed person is a known person or a stranger. Face detection and recognition computations are performed on device, not at the cloud. No sensitive information is transmitted off device and privacy is thus preserved.
Information query