Invention Application
- Patent Title: Multi-head neural network model to simultaneously predict multiple physiological signals from facial RGB video
-
Application No.: US17215915Application Date: 2021-03-29
-
Publication No.: US20210304001A1Publication Date: 2021-09-30
- Inventor: Jack Po , Jiening Zhan , Jiang Wu , Silviu Borac , Yunus Emre
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/04 ; A61B5/0205 ; G06K9/00 ; G16H40/67 ; G16H80/00

Abstract:
A method for estimating two or more physiological signals from a subject includes steps of a) obtaining a video input in the form of a sequence of frames of image data depicting the face and optionally the chest of the subject; b) providing the video input to a multi-head neural network model trained from a set of facial video inputs from a multitude of other subjects (such video inputs optionally including the chest), wherein the model has at least two heads and is trained to predict at least two physiological signals from a video input; and c) generating with the model data representing an estimate of the two or more physiological signals of the subject. In one embodiment the physiological signals are heart rate and respiratory rate. In one embodiment the multi-head neural network model is implemented in a smartphone having a camera which is used to capture the video input.
Information query