-
公开(公告)号:US12002227B1
公开(公告)日:2024-06-04
申请号:US17376313
申请日:2021-07-15
Applicant: Apple Inc.
Inventor: Donghoon Lee , Thorsten Gernoth , Onur C. Hamsici , Shuo Feng
CPC classification number: G06T7/344 , G06N3/08 , G06T15/205 , G06T2207/20081 , G06T2207/20084
Abstract: Devices, systems, and methods are disclosed for partial point cloud registration. In some implementations, a method includes obtaining a first set of three-dimensional (3D) points corresponding to an object in a physical environment, the first set of 3D points having locations in a first coordinate system, obtaining a second set of 3D points corresponding to the object in the physical environment, the second set of 3D points having locations in a second coordinate system, predicting, via a machine learning model, locations of the first set of 3D points in the second coordinate system, and determining transform parameters relating the first set of 3D points and the second set of 3D points based on the predicted location of the first set of 3D points in the second coordinate system.
-
公开(公告)号:US20240062488A1
公开(公告)日:2024-02-22
申请号:US18385943
申请日:2023-11-01
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Chen Huang , Onur C. Hamsici , Shuo Feng , Hao Tang , Tobias Rick
CPC classification number: G06T19/006 , G06T7/20 , G06F9/453 , G06F3/04815 , G06V20/10 , G06V20/64
Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model of an object based on images and tracked positions of a device during acquisition of the images. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment acquired via a camera on the device, identifying the object in at least some of the images, tracking positions of the device during acquisition of the images based on identifying the object in the at least some of the images, the positions identifying positioning of the device with respect to a coordinate system defined based on a position and orientation of the object, and generating a 3D model of the object based on the images and positions of the device during acquisition of the images.
-
公开(公告)号:US11693937B2
公开(公告)日:2023-07-04
申请号:US16395979
申请日:2019-04-26
Applicant: Apple Inc.
Inventor: Marcel Van Os , Thorsten Gernoth , Kelsey Y. Ho
CPC classification number: G06F21/32 , G06V40/166 , G06V40/171 , G06V40/172
Abstract: An operation of a facial recognition authentication process may fail to authenticate a user even if the user is an authorized user of the device. In such cases, the facial recognition authentication process may automatically re-initiate to provide another attempt to authenticate the user using additional captured images. For the new attempt (e.g., the retry) to authenticate the user, one or more criteria for the images used in the facial recognition authentication process may be adjusted. For example, criteria for distance between the camera and the user's face and/or occlusion of the user's face in the images may be adjusted before the new attempt to authenticate the user. Adjustment of these criteria may increase the likelihood that the authorized user will be successfully authenticated in the new attempt.
-
公开(公告)号:US20210279967A1
公开(公告)日:2021-09-09
申请号:US17179487
申请日:2021-02-19
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Chen Huang , Onur C. Hamsici , Shuo Feng , Hao Tang , Tobias Rick
IPC: G06T19/00 , G06T7/20 , G06K9/00 , G06F3/0481 , G06F9/451
Abstract: Various implementations disclosed herein include devices, systems, and methods that generates a three-dimensional (3D) model of an object based on images and tracked positions of a device during acquisition of the images. For example, an example process may include acquiring sensor data during movement of the device in a physical environment including an object, the sensor data including images of a physical environment acquired via a camera on the device, identifying the object in at least some of the images, tracking positions of the device during acquisition of the images based on identifying the object in the at least some of the images, the positions identifying positioning of the device with respect to a coordinate system defined based on a position and orientation of the object, and generating a 3D model of the object based on the images and positions of the device during acquisition of the images.
-
公开(公告)号:US10896318B2
公开(公告)日:2021-01-19
申请号:US15934559
申请日:2018-03-23
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Ian R. Fasel , Touraj Tajbakhsh , Jia-Chi Wu
Abstract: Occlusion of facial features may be detected and assessed in an image captured by a camera on a device. Landmark heat maps may be used to estimate the location of landmarks such as the eyes, mouth, and nose of a user's face in the captured image. An occlusion heat map may also be generated for the captured image. The occlusion heat map may include values representing the amount of occlusion in regions of the face. The estimated locations of the eyes, mouth, and nose may be used in combination with the occlusion heat map to assess occlusion scores for the landmarks. The occlusion scores for the landmarks may be used control one or more operations of the device.
-
公开(公告)号:US20190080149A1
公开(公告)日:2019-03-14
申请号:US15934559
申请日:2018-03-23
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Ian R. Fasel , Touraj Tajbakhsh , Jia-Chi Wu
Abstract: Occlusion of facial features may be detected and assessed in an image captured by a camera on a device. Landmark heat maps may be used to estimate the location of landmarks such as the eyes, mouth, and nose of a user's face in the captured image. An occlusion heat map may also be generated for the captured image. The occlusion heat map may include values representing the amount of occlusion in regions of the face. The estimated locations of the eyes, mouth, and nose may be used in combination with the occlusion heat map to assess occlusion scores for the landmarks. The occlusion scores for the landmarks may be used control one or more operations of the device.
-
公开(公告)号:US10210381B1
公开(公告)日:2019-02-19
申请号:US16051030
申请日:2018-07-31
Applicant: Apple Inc.
Inventor: Eslam A. Mostafa , Thorsten Gernoth , Kelsey Y. Ho
Abstract: A facial recognition authentication on a device having a camera may operate with multiple enrollment profiles on the device. Multiple enrollment profiles may include separate profiles for different appearances of a user and/or separate profiles for different users authorized to use the device. The enrollment profiles may be generated using an enrollment process where the enrollment process is operated separately to generate each of the different enrollment profiles. During the facial recognition authentication process, a user may unlock the device by having a matching score for image(s) captured of the user that that exceeds an unlock threshold for at least one of the enrollment profiles. The user may have a matching score that exceeds the unlock threshold for multiple enrollment profiles. Each enrollment profile unlocks the device for the user may be updated using a template update process that operates independently for each enrollment profile.
-
公开(公告)号:US20190042718A1
公开(公告)日:2019-02-07
申请号:US16050021
申请日:2018-07-31
Applicant: Apple Inc.
Inventor: Deepti S. Prakash , Lucia E. Ballard , Jerrold V. Hauck , Feng Tang , Etai Littwin , Pavan Kumar Ansosalu Vasu , Gideon Littwin , Thorsten Gernoth , Lucie Kucerova , Petr Kostka , Steven P. Hotelling , Eitan Hirsh , Tal Kaitz , Jonathan Pokrass , Andrei Kolin , Moshe Laifenfeld , Matthew C. Waldon , Thomas P. Mensch , Lynn R. Youngs , Christopher G. Zeleznik , Michael R. Malone , Ziv Hendel , Ivan Krstic , Anup K. Sharma , Kelsey Y. Ho
Abstract: Techniques are disclosed relating to biometric authentication, e.g., facial recognition. In some embodiments, a device is configured to verify that image data from a camera unit exhibits a pseudo-random sequence of image capture modes and/or a probing pattern of illumination points (e.g., from lasers in a depth capture mode) before authenticating a user based on recognizing a face in the image data. In some embodiments, a secure circuit may control verification of the sequence and/or the probing pattern. In some embodiments, the secure circuit may verify frame numbers, signatures, and/or nonce values for captured image information. In some embodiments, a device may implement one or more lockout procedures in response to biometric authentication failures. The disclosed techniques may reduce or eliminate the effectiveness of spoofing and/or replay attacks, in some embodiments.
-
29.
公开(公告)号:US20180348885A1
公开(公告)日:2018-12-06
申请号:US16055994
申请日:2018-08-06
Applicant: Apple Inc.
Inventor: Feng Tang , Chong Chen , Haitao Guo , Xiaojin Shi , Thorsten Gernoth
CPC classification number: G06F3/017 , G06F3/011 , G06F3/012 , G06F3/0304 , G06F3/16 , G06F3/165 , G06K9/00375 , G06K9/00389 , G06K9/6269 , G06K9/6282 , G06K2209/40
Abstract: Intelligent systems are disclosed that respond to user intent and desires based upon activity that may or may not be expressly directed at the intelligent system. In some embodiments, the intelligent system acquires a depth image of a scene surrounding the system. A scene geometry may be extracted from the depth image and elements of the scene may be monitored. In certain embodiments, user activity in the scene is monitored and analyzed to infer user desires or intent with respect to the system. The interpretation of the user's intent as well as the system's response may be affected by the scene geometry surrounding the user and/or the system. In some embodiments, techniques and systems are disclosed for interpreting express user communication, e.g., expressed through hand gesture movements. In some embodiments, such gesture movements may be interpreted based on real-time depth information obtained from, e.g., optical or non-optical type depth sensors.
-
公开(公告)号:US20240378827A1
公开(公告)日:2024-11-14
申请号:US18765506
申请日:2024-07-08
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Chen Huang , Onur C. Hamsici , Shuo Feng , Hao Tang , Tobias Rick
Abstract: Various implementations disclosed herein include devices, systems, and methods that track a position of a device within an object-based coordinate system. An example process may include, at a device and prior to movement of an object, acquiring first images of the object, identifying three-dimensional (3D) keypoints on surfaces of the object, and tracking positions of the device in an object-based coordinate system during acquisition of the first images. The process may further include, subsequent to a movement of the object, acquiring second images of the object, identifying the 3D keypoints on surfaces of the object, and tracking positions of the device in the object-based coordinate system during acquisition of the second images based on identifying the 3D keypoints. The process may further include generating a 3D model of the object based on the first and second images and the tracked positions of the device during acquisition of the images.
-
-
-
-
-
-
-
-
-