Invention Publication
- Patent Title: PERSONALIZED CALIBRATION FUNCTIONS FOR USER GAZE DETECTION IN AUTONOMOUS DRIVING APPLICATIONS
-
Application No.: US18410801Application Date: 2024-01-11
-
Publication No.: US20240143072A1Publication Date: 2024-05-02
- Inventor: Nuri Murat Arar , Sujay Yadawadkar , Hairong Jiang , Nishant Puri , Niranjan Avadhanam
- Applicant: NVIDIA Corporation
- Applicant Address: US CA Santa Clara
- Assignee: NVIDIA Corporation
- Current Assignee: NVIDIA Corporation
- Current Assignee Address: US CA Santa Clara
- Main IPC: G06F3/01
- IPC: G06F3/01 ; G06F18/21 ; G06F18/214 ; G06V10/46 ; G06V20/59 ; G06V40/16

Abstract:
In various examples, systems and methods are disclosed that provide highly accurate gaze predictions that are specific to a particular user by generating and applying, in deployment, personalized calibration functions to outputs and/or layers of a machine learning model. The calibration functions corresponding to a specific user may operate on outputs (e.g., gaze predictions from a machine learning model) to provide updated values and gaze predictions. The calibration functions may also be applied one or more last layers of the machine learning model to operate on features identified by the model and provide values that are more accurate. The calibration functions may be generated using explicit calibration methods by instructing users to gaze at a number of identified ground truth locations within the interior of the vehicle. Once generated, the calibration functions may be modified or refined through implicit gaze calibration points and/or regions based on gaze saliency maps.
Information query