公开(公告)号：US20210089887A1

公开(公告)日：2021-03-25

申请号：US16832934

申请日：2020-03-27

Applicant: Apple Inc.

Inventor： Tyler B. Johnson ,  Carlos E. Guestrin ,  Pulkit Agrawal ,  Haijie Gu

IPC: G06N3/08

Abstract: A method includes determining a training scale for training a machine-learning model, defining a group of worker nodes having a number of worker nodes that is selected according to the training scale, and determining an average gradient of a loss function during a training iteration using the group of worker nodes. The method also includes determining a variance value for the average gradient of the loss function, determining a gain ratio based on the variance value for the average gradient of the loss function, and determining a learning rate parameter based on a learning rate schedule and the gain ratio. The method also includes determining updated parameters for the machine-learning model using the learning rate parameter and the average gradient of the loss function.

公开(公告)号：US11915460B2

公开(公告)日：2024-02-27

申请号：US17860030

申请日：2022-07-07

Applicant: Apple Inc.

Inventor： Carlos E. Guestrin ,  Leon A. Gatys ,  Shreyas V. Joshi ,  Gustav M. Larsson ,  Kory R. Watson ,  Srikrishna Sridhar ,  Karla P. Vega ,  Shawn R. Scully ,  Thorsten Gernoth ,  Onur C Hamsici

IPC: G06T7/194 ,  G06V10/143 ,  G06N20/00 ,  G06T3/40 ,  G06V10/774

CPC classification number: G06V10/143 ,  G06N20/00 ,  G06T3/40 ,  G06T7/194 ,  G06V10/774 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/20081 ,  G06T2207/20224 ,  G06T2207/30201

Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.

公开(公告)号：US11789528B1

公开(公告)日：2023-10-17

申请号：US17461367

申请日：2021-08-30

Applicant: Apple Inc.

Inventor： Jeffrey P. Bigham ,  Mingzhe Li ,  Samuel C. White ,  Xiaoyi Zhang ,  Qi Shan ,  Carlos E. Guestrin

IPC: G06F3/01 ,  G06V40/19 ,  G06V40/60

CPC classification number: G06F3/013 ,  G06V40/19 ,  G06V40/67

Abstract: Calibration of eye tracking is improved by collecting additional calibration pairs when user is using apps with eye tracking. A user input component is presented on a display of an electronic device, detecting a dwelling action for user input component, and in response to detecting the dwelling action, obtaining a calibration pair comprising an uncalibrated gaze point and a screen location of the user input component, wherein the uncalibrated gaze point is determined based on an eye pose during the dwelling action. A screen gaze estimation is determine based on the uncalibrated gaze point, and in response to determining that the calibration pair is a valid calibration pair, training a calibration model using the calibration pair.

公开(公告)号：US11386355B2

公开(公告)日：2022-07-12

申请号：US16706578

申请日：2019-12-06

Applicant: Apple Inc.

Inventor： Carlos E. Guestrin ,  Leon A. Gatys ,  Shreyas V. Joshi ,  Gustav M. Larsson ,  Kory R. Watson ,  Srikrishna Sridhar ,  Karla P. Vega ,  Shawn R. Scully ,  Thorsten Gernoth ,  Onur C Hamsici

IPC: G06T7/194 ,  G06N20/00 ,  G06T3/40

Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.

公开(公告)号：US11106280B1

公开(公告)日：2021-08-31

申请号：US17027266

申请日：2020-09-21

Applicant: Apple Inc.

Inventor： Jeffrey P. Bigham ,  Mingzhe Li ,  Samuel C. White ,  Xiaoyi Zhang ,  Qi Shan ,  Carlos E. Guestrin

IPC: G06F3/01 ,  G06K9/00

Abstract: Calibration of eye tracking is improved by collecting additional calibration pairs when user is using apps with eye tracking. A user input component is presented on a display of an electronic device, detecting a dwelling action for user input component, and in response to detecting the dwelling action, obtaining a calibration pair comprising an uncalibrated gaze point and a screen location of the user input component, wherein the uncalibrated gaze point is determined based on an eye pose during the dwelling action. A screen gaze estimation is determine based on the uncalibrated gaze point, and in response to determining that the calibration pair is a valid calibration pair, training a calibration model using the calibration pair.