公开(公告)号：US11630510B2

公开(公告)日：2023-04-18

申请号：US17304615

申请日：2021-06-23

Applicant: Huawei Technologies Co., Ltd.

Inventor： Zhenhao Li ,  Rasoul Mohammadi Nasiri ,  Zheng Liu ,  Hisham Elhalabi ,  Yuanhao Yu ,  Roel Vertegaal ,  Yang Wang ,  Jin Tang

IPC: G06F3/01 ,  G06T7/80 ,  G06T17/20 ,  G06V40/16

Abstract: A system and a method for performing 2D on-screen user gaze estimation using an input facial image of a user captured using a camera associated to a processing device having a display. The method and system allow automated user calibration through automatic recording of calibration samples each including a calibration facial image of the user and an interaction point corresponding to a point on the display where an occurrence of a user interaction was detected when the corresponding calibration image was captured. The system and method also optimize user-specific parameters using the calibration samples by iteratively minimizing a total difference between the interaction points of a plurality of the calibration samples and corresponding 2D gaze estimation results and convert an estimated 3D gaze direction into a 2D gaze estimation result corresponding to a point on the display, by applying the users-specific parameters.