公开(公告)号：US11915460B2

公开(公告)日：2024-02-27

申请号：US17860030

申请日：2022-07-07

Applicant: Apple Inc.

Inventor： Carlos E. Guestrin ,  Leon A. Gatys ,  Shreyas V. Joshi ,  Gustav M. Larsson ,  Kory R. Watson ,  Srikrishna Sridhar ,  Karla P. Vega ,  Shawn R. Scully ,  Thorsten Gernoth ,  Onur C Hamsici

IPC: G06T7/194 ,  G06V10/143 ,  G06N20/00 ,  G06T3/40 ,  G06V10/774

CPC classification number: G06V10/143 ,  G06N20/00 ,  G06T3/40 ,  G06T7/194 ,  G06V10/774 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/20081 ,  G06T2207/20224 ,  G06T2207/30201

Abstract: A device implementing a system for providing predicted RGB images includes at least one processor configured to obtain an infrared image of a subject, and to obtain a reference RGB image of the subject. The at least one processor is further configured to provide the infrared image and the reference RGB image to a machine learning model, the machine learning model having been trained to output predicted RGB images of subjects based on infrared images and reference RGB images of the subjects. The at least one processor is further configured to provide a predicted RGB image of the subject based on output by the machine learning model.

公开(公告)号：US11868455B2

公开(公告)日：2024-01-09

申请号：US17182076

申请日：2021-02-22

Applicant: Apple Inc.

Inventor： Deepti S. Prakash ,  Lucia E. Ballard ,  Jerrold V. Hauck ,  Feng Tang ,  Etai Littwin ,  Pavan Kumar Anasosalu Vasu ,  Gideon Littwin ,  Thorsten Gernoth ,  Lucie Kucerova ,  Petr Kostka ,  Steven P. Hotelling ,  Eitan Hirsh ,  Tal Kaitz ,  Jonathan Pokrass ,  Andrei Kolin ,  Moshe Laifenfeld ,  Matthew C. Waldon ,  Thomas P. Mensch ,  Lynn R. Youngs ,  Christopher G. Zeleznik ,  Michael R. Malone ,  Ziv Hendel ,  Ivan Krstic ,  Anup K. Sharma

IPC: G06F21/32 ,  H04L9/32 ,  H04W12/06 ,  H04L9/40 ,  G06F21/83 ,  G06V40/40 ,  G06V40/16 ,  H04L9/08

CPC classification number: G06F21/32 ,  G06F21/83 ,  G06V40/166 ,  G06V40/172 ,  G06V40/40 ,  H04L9/085 ,  H04L9/0844 ,  H04L9/3228 ,  H04L9/3231 ,  H04L9/3234 ,  H04L9/3247 ,  H04L63/0861 ,  H04W12/06

Abstract: Techniques are disclosed relating to biometric authentication, e.g., facial recognition. In some embodiments, a device is configured to verify that image data from a camera unit exhibits a pseudo-random sequence of image capture modes and/or a probing pattern of illumination points (e.g., from lasers in a depth capture mode) before authenticating a user based on recognizing a face in the image data. In some embodiments, a secure circuit may control verification of the sequence and/or the probing pattern. In some embodiments, the secure circuit may verify frame numbers, signatures, and/or nonce values for captured image information. In some embodiments, a device may implement one or more lockout procedures in response to biometric authentication failures. The disclosed techniques may reduce or eliminate the effectiveness of spoofing and/or replay attacks, in some embodiments.

公开(公告)号：US11521423B2

公开(公告)日：2022-12-06

申请号：US17150270

申请日：2021-01-15

Applicant: Apple Inc.

Inventor： Thorsten Gernoth ,  Ian R. Fasel ,  Touraj Tajbakhsh ,  Jia-Chi Wu

IPC: G06K9/00 ,  G06V40/16 ,  G06F21/32 ,  G06V10/20 ,  G06V10/98 ,  G06V40/50 ,  H04N5/232

Abstract: Occlusion of facial features may be detected and assessed in an image captured by a camera on a device. Landmark heat maps may be used to estimate the location of landmarks such as the eyes, mouth, and nose of a user's face in the captured image. An occlusion heat map may also be generated for the captured image. The occlusion heat map may include values representing the amount of occlusion in regions of the face. The estimated locations of the eyes, mouth, and nose may be used in combination with the occlusion heat map to assess occlusion scores for the landmarks. The occlusion scores for the landmarks may be used control one or more operations of the device.

公开(公告)号：US20210133428A1

公开(公告)日：2021-05-06

申请号：US17150270

申请日：2021-01-15

Applicant: Apple Inc.

Inventor： Thorsten Gernoth ,  Ian R. Fasel ,  Touraj Tajbakhsh ,  Jia-Chi Wu

IPC: G06K9/00 ,  G06F21/32 ,  G06K9/03 ,  G06K9/80

Abstract: Occlusion of facial features may be detected and assessed in an image captured by a camera on a device. Landmark heat maps may be used to estimate the location of landmarks such as the eyes, mouth, and nose of a user's face in the captured image. An occlusion heat map may also be generated for the captured image. The occlusion heat map may include values representing the amount of occlusion in regions of the face. The estimated locations of the eyes, mouth, and nose may be used in combination with the occlusion heat map to assess occlusion scores for the landmarks. The occlusion scores for the landmarks may be used control one or more operations of the device.

公开(公告)号：US10929515B2

公开(公告)日：2021-02-23

申请号：US16049933

申请日：2018-07-31

Applicant: Apple Inc.

Inventor： Deepti S. Prakash ,  Lucia E. Ballard ,  Jerrold V. Hauck ,  Feng Tang ,  Etai Littwin ,  Pavan Kumar Ansosalu Vasu ,  Gideon Littwin ,  Thorsten Gernoth ,  Lucie Kucerova ,  Petr Kostka ,  Steven P. Hotelling ,  Eitan Hirsh ,  Tal Kaitz ,  Jonathan Pokrass ,  Andrei Kolin ,  Moshe Laifenfeld ,  Matthew C. Waldon ,  Thomas P. Mensch ,  Lynn R. Youngs ,  Christopher G. Zeleznik ,  Michael R. Malone ,  Ziv Hendel ,  Ivan Krstic ,  Anup K. Sharma

IPC: G06F21/00 ,  G06F21/32 ,  G06K9/00 ,  H04L9/32 ,  H04W12/06 ,  H04L29/06 ,  G06F21/83 ,  H04L9/08

Abstract: Techniques are disclosed relating to biometric authentication, e.g., facial recognition. In some embodiments, a device is configured to verify that image data from a camera unit exhibits a pseudo-random sequence of image capture modes and/or a probing pattern of illumination points (e.g., from lasers in a depth capture mode) before authenticating a user based on recognizing a face in the image data. In some embodiments, a secure circuit may control verification of the sequence and/or the probing pattern. In some embodiments, the secure circuit may verify frame numbers, signatures, and/or nonce values for captured image information. In some embodiments, a device may implement one or more lockout procedures in response to biometric authentication failures. The disclosed techniques may reduce or eliminate the effectiveness of spoofing and/or replay attacks, in some embodiments.

公开(公告)号：US10762335B2

公开(公告)日：2020-09-01

申请号：US15934578

申请日：2018-03-23

Applicant: Apple Inc.

Inventor： Thorsten Gernoth ,  Joerg A. Liebelt ,  Onur C. Hamsici ,  Kelsey Y. Ho

IPC: G06K9/00 ,  G06F3/01 ,  G06N20/00 ,  G06F15/76 ,  G06F1/3234 ,  G06K9/62 ,  G06F1/3231 ,  G06N3/04 ,  G06N3/08 ,  G06N20/10

Abstract: Detection of a user paying attention to a device may be used to enable or support biometric security (e.g., facial recognition) enabled features on the device. Images captured by a camera on the device may be used to determine if the user is paying attention to the device. Facial features of the user's face in the images may be assessed to determine if the user is paying attention to the device. Facial features may be assessed through comparison of feature vectors generated from the captured image feature to a set of known feature vectors. The known feature vectors for attention may be generated using a machine learning process.

公开(公告)号：US10713475B2

公开(公告)日：2020-07-14

申请号：US15910551

申请日：2018-03-02

Applicant: Apple Inc.

Inventor： Thorsten Gernoth ,  Atulit Kumar ,  Ian R. Fasel ,  Haitao Guo ,  Onur C. Hamsici

IPC: G06K9/00 ,  G06T7/521 ,  G06K9/62 ,  G06K9/20

Abstract: A single network encodes and decodes an image captured using a camera on a device. The single network detects if a face is in the image. If a face is detected in the image, the single network determines properties of the face in the image and outputs the properties along with the face detection output. Properties of the face may be determined by sharing the task for face detection. Properties of the face that are output along with the face detection output include the location of the face, the pose of the face, and/or the distance of the face from the camera.

公开(公告)号：US10401158B2

公开(公告)日：2019-09-03

申请号：US15912917

申请日：2018-03-06

Applicant: Apple Inc.

Inventor： Thorsten Gernoth ,  Ian R. Fasel ,  Haitao Guo ,  Atulit Kumar

IPC: G01B11/25 ,  G01B11/14 ,  G06T7/73 ,  G06T7/514 ,  G06K9/00 ,  G06K9/20 ,  H04N5/225 ,  H04N5/33

Abstract: An estimate of distance between a user and a camera on a device is used to determine an illumination pattern density used for speckle pattern illumination of the user in subsequent images. The distance may be estimated using an image captured when the user is illuminated with flood infrared illumination. Either a sparse speckle (dot) pattern illumination pattern or a dense speckle pattern illumination pattern is used depending on the distance between the user's face and the camera.

公开(公告)号：US20190213394A1

公开(公告)日：2019-07-11

申请号：US16240970

申请日：2019-01-07

Applicant: Apple Inc.

Inventor： Eslam A. Mostafa ,  Thorsten Gernoth ,  Kelsey Y. Ho

IPC: G06K9/00 ,  G06F21/32

CPC classification number: G06K9/00288 ,  G06F21/32 ,  G06K9/00281 ,  G06K9/6218 ,  G06T2207/20084

Abstract: A facial recognition authentication on a device having a camera may operate with multiple enrollment profiles on the device. Multiple enrollment profiles may include separate profiles for different appearances of a user and/or separate profiles for different users authorized to use the device. The enrollment profiles may be generated using an enrollment process where the enrollment process is operated separately to generate each of the different enrollment profiles. During the facial recognition authentication process, a user may unlock the device by having a matching score for image(s) captured of the user that that exceeds an unlock threshold for at least one of the enrollment profiles. The user may have a matching score that exceeds the unlock threshold for multiple enrollment profiles. Each enrollment profile unlocks the device for the user may be updated using a template update process that operates independently for each enrollment profile.

公开(公告)号：US20190044723A1

公开(公告)日：2019-02-07

申请号：US16049933

申请日：2018-07-31

Applicant: Apple Inc.

Inventor： Deepti S. Prakash ,  Lucia E. Ballard ,  Jerrold V. Hauck ,  Feng Tang ,  Etai Littwin ,  Pavan Kumar Ansosalu Vasu ,  Gideon Littwin ,  Thorsten Gernoth ,  Lucie Kucerova ,  Petr Kostka ,  Steven P. Hotelling ,  Eitan Hirsh ,  Tal Kaitz ,  Jonathan Pokrass ,  Andrei Kolin ,  Moshe Laifenfeld ,  Matthew C. Waldon ,  Thomas P. Mensch ,  Lynn R. Youngs ,  Christopher G. Zeleznik ,  Michael R. Malone ,  Ziv Hendel ,  Ivan Krstic ,  Anup K. Sharma

IPC: H04L9/32 ,  G06F21/32 ,  H04L9/08 ,  G06K9/00

Abstract: Techniques are disclosed relating to biometric authentication, e.g., facial recognition. In some embodiments, a device is configured to verify that image data from a camera unit exhibits a pseudo-random sequence of image capture modes and/or a probing pattern of illumination points (e.g., from lasers in a depth capture mode) before authenticating a user based on recognizing a face in the image data. In some embodiments, a secure circuit may control verification of the sequence and/or the probing pattern. In some embodiments, the secure circuit may verify frame numbers, signatures, and/or nonce values for captured image information. In some embodiments, a device may implement one or more lockout procedures in response to biometric authentication failures. The disclosed techniques may reduce or eliminate the effectiveness of spoofing and/or replay attacks, in some embodiments.