-
公开(公告)号:US10896318B2
公开(公告)日:2021-01-19
申请号:US15934559
申请日:2018-03-23
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Ian R. Fasel , Touraj Tajbakhsh , Jia-Chi Wu
Abstract: Occlusion of facial features may be detected and assessed in an image captured by a camera on a device. Landmark heat maps may be used to estimate the location of landmarks such as the eyes, mouth, and nose of a user's face in the captured image. An occlusion heat map may also be generated for the captured image. The occlusion heat map may include values representing the amount of occlusion in regions of the face. The estimated locations of the eyes, mouth, and nose may be used in combination with the occlusion heat map to assess occlusion scores for the landmarks. The occlusion scores for the landmarks may be used control one or more operations of the device.
-
公开(公告)号:US20190080149A1
公开(公告)日:2019-03-14
申请号:US15934559
申请日:2018-03-23
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Ian R. Fasel , Touraj Tajbakhsh , Jia-Chi Wu
Abstract: Occlusion of facial features may be detected and assessed in an image captured by a camera on a device. Landmark heat maps may be used to estimate the location of landmarks such as the eyes, mouth, and nose of a user's face in the captured image. An occlusion heat map may also be generated for the captured image. The occlusion heat map may include values representing the amount of occlusion in regions of the face. The estimated locations of the eyes, mouth, and nose may be used in combination with the occlusion heat map to assess occlusion scores for the landmarks. The occlusion scores for the landmarks may be used control one or more operations of the device.
-
公开(公告)号:US20240331447A1
公开(公告)日:2024-10-03
申请号:US18478197
申请日:2023-09-29
Applicant: Apple Inc.
Inventor: Itay Bar Yosef , Bhavin Vinodkumar Nayak , Chao-Ming Yen , Chase B. Lortie , Daniel J. Brewer , Dror Irony , Eslam A. Mostafa , Guy Engelhard , Ian R. Fasel , Julian K. Shutzberg , Liuhao Ge , Lucas Soffer , Matthias M. Schroeder , Mohammadhadi Kiapour , Victor Belyaev , Yirong Tang
Abstract: Processing gesture input includes obtaining hand tracking data based on a set of camera frames, determining a hand pose based on the hand tracking data, and determining an intentionality classification for a gesture based on the hand pose. An input action corresponding to the gesture is enabled based on the hand pose and the intentionality classification. An occlusion classification is determined for the hand based on the hand pose and the input gesture can be determined based on the occlusion classification.
-
公开(公告)号:US20190041197A1
公开(公告)日:2019-02-07
申请号:US15912917
申请日:2018-03-06
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Ian R. Fasel , Haitao Guo , Atulit Kumar
CPC classification number: G06T7/514 , G01B11/14 , G06K9/00221 , G06K9/2027 , G06K9/2036 , G06T7/74 , G06T2207/10048 , G06T2207/30244 , H04N5/2251 , H04N5/2256 , H04N5/33
Abstract: An estimate of distance between a user and a camera on a device is used to determine an illumination pattern density used for speckle pattern illumination of the user in subsequent images. The distance may be estimated using an image captured when the user is illuminated with flood infrared illumination. Either a sparse speckle (dot) pattern illumination pattern or a dense speckle pattern illumination pattern is used depending on the distance between the user's face and the camera.
-
公开(公告)号:US10650540B2
公开(公告)日:2020-05-12
申请号:US16513854
申请日:2019-07-17
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Ian R. Fasel , Haitao Guo , Atulit Kumar
Abstract: An estimate of distance between a user and a camera on a device is used to determine an illumination pattern density used for speckle pattern illumination of the user in subsequent images. The distance may be estimated using an image captured when the user is illuminated with flood infrared illumination. Either a sparse speckle (dot) pattern illumination pattern or a dense speckle pattern illumination pattern is used depending on the distance between the user's face and the camera.
-
6.
公开(公告)号:US20190042833A1
公开(公告)日:2019-02-07
申请号:US15910551
申请日:2018-03-02
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Atulit Kumar , Ian R. Fasel , Haitao Guo , Onur C. Hamsici
CPC classification number: G06K9/00288 , G06K9/00221 , G06K9/00255 , G06K9/00302 , G06K9/2036 , G06K9/6273 , G06K2209/401 , G06T7/521
Abstract: A single network encodes and decodes an image captured using a camera on a device. The single network detects if a face is in the image. If a face is detected in the image, the single network determines properties of the face in the image and outputs the properties along with the face detection output. Properties of the face may be determined by sharing the task for face detection. Properties of the face that are output along with the face detection output include the location of the face, the pose of the face, and/or the distance of the face from the camera.
-
公开(公告)号:US20240402800A1
公开(公告)日:2024-12-05
申请号:US18676786
申请日:2024-05-29
Applicant: Apple Inc.
Inventor: Julian K. Shutzberg , David J. Meyer , David M. Teitelbaum , Mehmet N. Agaoglu , Ian R. Fasel , Chase B. Lortie , Daniel J. Brewer , Tim H. Cornelissen , Leah M. Gum , Alexander G. Berardino , Lorenzo Soto Doblado , Vinay Chawda , Itay Bar Yosef , Dror Irony , Eslam A. Mostafa , Guy Engelhard , Paul A. Lacey , Ashwin Kumar Asoka Kumar Shenoi , Bhavin Vinodkumar Nayak , Liuhao Ge , Lucas Soffer , Victor Belyaev , Bharat C. Dandu , Matthias M. Schroeder , Yirong Tang
IPC: G06F3/01 , G06F3/04815
Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.
-
公开(公告)号:US11521423B2
公开(公告)日:2022-12-06
申请号:US17150270
申请日:2021-01-15
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Ian R. Fasel , Touraj Tajbakhsh , Jia-Chi Wu
Abstract: Occlusion of facial features may be detected and assessed in an image captured by a camera on a device. Landmark heat maps may be used to estimate the location of landmarks such as the eyes, mouth, and nose of a user's face in the captured image. An occlusion heat map may also be generated for the captured image. The occlusion heat map may include values representing the amount of occlusion in regions of the face. The estimated locations of the eyes, mouth, and nose may be used in combination with the occlusion heat map to assess occlusion scores for the landmarks. The occlusion scores for the landmarks may be used control one or more operations of the device.
-
公开(公告)号:US20210133428A1
公开(公告)日:2021-05-06
申请号:US17150270
申请日:2021-01-15
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Ian R. Fasel , Touraj Tajbakhsh , Jia-Chi Wu
Abstract: Occlusion of facial features may be detected and assessed in an image captured by a camera on a device. Landmark heat maps may be used to estimate the location of landmarks such as the eyes, mouth, and nose of a user's face in the captured image. An occlusion heat map may also be generated for the captured image. The occlusion heat map may include values representing the amount of occlusion in regions of the face. The estimated locations of the eyes, mouth, and nose may be used in combination with the occlusion heat map to assess occlusion scores for the landmarks. The occlusion scores for the landmarks may be used control one or more operations of the device.
-
10.
公开(公告)号:US10713475B2
公开(公告)日:2020-07-14
申请号:US15910551
申请日:2018-03-02
Applicant: Apple Inc.
Inventor: Thorsten Gernoth , Atulit Kumar , Ian R. Fasel , Haitao Guo , Onur C. Hamsici
Abstract: A single network encodes and decodes an image captured using a camera on a device. The single network detects if a face is in the image. If a face is detected in the image, the single network determines properties of the face in the image and outputs the properties along with the face detection output. Properties of the face may be determined by sharing the task for face detection. Properties of the face that are output along with the face detection output include the location of the face, the pose of the face, and/or the distance of the face from the camera.
-
-
-
-
-
-
-
-
-