公开(公告)号：US20210225090A1

公开(公告)日：2021-07-22

申请号：US17148682

申请日：2021-01-14

Applicant: Apple Inc

Inventor： Feng Tang ,  Afshin Dehghan ,  Kai Kang ,  Yang Yang ,  Yikang Liao ,  Guangyu Zhao

IPC: G06T19/20 ,  G06T15/20 ,  G06K9/00 ,  G06N3/04 ,  G06T7/50

Abstract: Various implementations disclosed herein include devices, systems, and methods that generate floorplans and measurements using a three-dimensional (3D) representation of a physical environment generated based on sensor data.

公开(公告)号：US10719692B2

公开(公告)日：2020-07-21

申请号：US15900905

申请日：2018-02-21

Applicant: Apple Inc.

Inventor： Micah P. Kalscheur ,  Feng Tang

IPC: G06K9/00 ,  G06F16/583 ,  G06F16/56 ,  G06F21/32

Abstract: Subepidermal imaging of a face may be used to assess subepidermal features such as blood vessels (e.g., veins) when the device is attempting to authenticate a user in a facial recognition authentication process. Assessment of the subepidermal features may be used to distinguish between users that have closely related facial features (e.g., siblings or twins) in situations where the facial recognition authentication process has less certainty in a decision about recognition of the user's face as an authorized user.

公开(公告)号：US20200042096A1

公开(公告)日：2020-02-06

申请号：US16600830

申请日：2019-10-14

Applicant: Apple Inc.

Inventor： Feng Tang ,  Chong Chen ,  Haitao Guo ,  Xiaojin Shi ,  Thorsten Gernoth

IPC: G06F3/01 ,  G06F3/03 ,  G06F3/16 ,  G06K9/00

Abstract: Intelligent systems are disclosed that respond to user intent and desires based upon activity that may or may not be expressly directed at the intelligent system. In some embodiments, the intelligent system acquires a depth image of a scene surrounding the system. A scene geometry may be extracted from the depth image and elements of the scene may be monitored. In certain embodiments, user activity in the scene is monitored and analyzed to infer user desires or intent with respect to the system. The interpretation of the user's intent as well as the system's response may be affected by the scene geometry surrounding the user and/or the system. In some embodiments, techniques and systems are disclosed for interpreting express user communication, e.g., expressed through hand gesture movements. In some embodiments, such gesture movements may be interpreted based on real-time depth information obtained from, e.g., optical or non-optical type depth sensors.

公开(公告)号：US09811721B2

公开(公告)日：2017-11-07

申请号：US14706649

申请日：2015-05-07

Applicant: Apple Inc.

Inventor： Feng Tang ,  Ang Li ,  Xiaojin Shi

IPC: G06K9/00 ,  H04N13/02 ,  G06K9/46 ,  G06F3/01 ,  G06F3/03 ,  G06F3/042 ,  G06T7/246 ,  G06T7/254 ,  H04N13/00

CPC classification number: G06K9/00355 ,  G06F3/017 ,  G06F3/0304 ,  G06F3/0425 ,  G06K9/4609 ,  G06T7/246 ,  G06T7/254 ,  G06T2200/04 ,  G06T2207/30196 ,  H04N13/207 ,  H04N13/271 ,  H04N2013/0085

Abstract: In the field of Human-computer interaction (HCI), i.e., the study of the interfaces between people (i.e., users) and computers, understanding the intentions and desires of how the user wishes to interact with the computer is a very important problem. The ability to understand human gestures, and, in particular, hand gestures, as they relate to HCI, is a very important aspect in understanding the intentions and desires of the user in a wide variety of applications. In this disclosure, a novel system and method for three-dimensional hand tracking using depth sequences is described. Some of the major contributions of the hand tracking system described herein include: 1.) a robust hand detector that is invariant to scene background changes; 2.) a bi-directional tracking algorithm that prevents detected hands from always drifting closer to the front of the scene (i.e., forward along the z-axis of the scene); and 3.) various hand verification heuristics.

公开(公告)号：US20170090584A1

公开(公告)日：2017-03-30

申请号：US14865850

申请日：2015-09-25

Applicant: Apple Inc.

Inventor： Feng Tang ,  Chong Chen ,  Haitao Guo ,  Xiaojin Shi ,  Thorsten Gernoth

IPC: G06F3/01 ,  G06K9/00 ,  G06F3/03 ,  G06F3/16 ,  G06T7/00 ,  G06T7/20

CPC classification number: G06F3/017 ,  G06F3/012 ,  G06F3/0304 ,  G06F3/16 ,  G06K9/00375 ,  G06K9/00389 ,  G06K9/6269 ,  G06K9/6282 ,  G06K2209/40

Abstract: Varying embodiments of intelligent systems are disclosed that respond to user intent and desires based upon activity that may or may not be expressly directed at the intelligent system. In some embodiments, the intelligent system acquires a depth image of a scene surrounding the system. A scene geometry may be extracted from the depth image and elements of the scene, such as walls, furniture, and humans may be evaluated and monitored. In certain embodiments, user activity in the scene is monitored and analyzed to infer user desires or intent with respect to the system. The interpretation of the user's intent or desire as well as the system's response may be affected by the scene geometry surrounding the user and/or the system. In some embodiments, techniques and systems are disclosed for interpreting express user communication, for example, expressed through fine hand gesture movements. In some embodiments, such gesture movements may be interpreted based on real-time depth information obtained from, for example, optical or non-optical type depth sensors. The depth information may be interpreted in “slices” (three-dimensional regions of space having a relatively small depth) until one or more candidate hand structures are detected. Once detected, each candidate hand structure may be confirmed or rejected based on its own unique physical properties (e.g., shape, size and continuity to an arm structure). Each confirmed hand structure may be submitted to a depth-aware filtering process before its own unique three-dimensional features are quantified into a high-dimensional feature vector. A two-step classification scheme may be applied to the feature vectors to identify a candidate gesture (step 1), and to reject candidate gestures that do not meet a gesture-specific identification operation (step-2). The identified gesture may be used to initiate some action controlled by a computer system.

公开(公告)号：US20240161410A1

公开(公告)日：2024-05-16

申请号：US18422429

申请日：2024-01-25

Applicant: Apple Inc.

Inventor： Feng Tang ,  Afshin Dehghan ,  Kai Kang ,  Yang Yang ,  Yikang Liao ,  Guangyu Zhao

IPC: G06T19/00 ,  G06F18/21 ,  G06F18/214 ,  G06F18/24 ,  G06N3/045 ,  G06T7/50 ,  G06T7/73 ,  G06T11/00 ,  G06T15/20 ,  G06T19/20 ,  G06V10/22 ,  G06V20/00 ,  G06V20/10 ,  G06V20/64 ,  G06V30/262 ,  H04N7/18

CPC classification number: G06T19/00 ,  G06F18/21 ,  G06F18/2148 ,  G06F18/217 ,  G06F18/24 ,  G06N3/045 ,  G06T7/50 ,  G06T7/73 ,  G06T11/00 ,  G06T15/205 ,  G06T19/003 ,  G06T19/20 ,  G06V10/22 ,  G06V20/10 ,  G06V20/36 ,  G06V20/64 ,  G06V30/274 ,  H04N7/183 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2210/04 ,  G06T2210/12 ,  G06T2210/56

Abstract: Various implementations disclosed herein include devices, systems, and methods that generate floorplans and measurements using a three-dimensional (3D) representation of a physical environment generated based on sensor data.

公开(公告)号：US11868455B2

公开(公告)日：2024-01-09

申请号：US17182076

申请日：2021-02-22

Applicant: Apple Inc.

Inventor： Deepti S. Prakash ,  Lucia E. Ballard ,  Jerrold V. Hauck ,  Feng Tang ,  Etai Littwin ,  Pavan Kumar Anasosalu Vasu ,  Gideon Littwin ,  Thorsten Gernoth ,  Lucie Kucerova ,  Petr Kostka ,  Steven P. Hotelling ,  Eitan Hirsh ,  Tal Kaitz ,  Jonathan Pokrass ,  Andrei Kolin ,  Moshe Laifenfeld ,  Matthew C. Waldon ,  Thomas P. Mensch ,  Lynn R. Youngs ,  Christopher G. Zeleznik ,  Michael R. Malone ,  Ziv Hendel ,  Ivan Krstic ,  Anup K. Sharma

IPC: G06F21/32 ,  H04L9/32 ,  H04W12/06 ,  H04L9/40 ,  G06F21/83 ,  G06V40/40 ,  G06V40/16 ,  H04L9/08

CPC classification number: G06F21/32 ,  G06F21/83 ,  G06V40/166 ,  G06V40/172 ,  G06V40/40 ,  H04L9/085 ,  H04L9/0844 ,  H04L9/3228 ,  H04L9/3231 ,  H04L9/3234 ,  H04L9/3247 ,  H04L63/0861 ,  H04W12/06

Abstract: Techniques are disclosed relating to biometric authentication, e.g., facial recognition. In some embodiments, a device is configured to verify that image data from a camera unit exhibits a pseudo-random sequence of image capture modes and/or a probing pattern of illumination points (e.g., from lasers in a depth capture mode) before authenticating a user based on recognizing a face in the image data. In some embodiments, a secure circuit may control verification of the sequence and/or the probing pattern. In some embodiments, the secure circuit may verify frame numbers, signatures, and/or nonce values for captured image information. In some embodiments, a device may implement one or more lockout procedures in response to biometric authentication failures. The disclosed techniques may reduce or eliminate the effectiveness of spoofing and/or replay attacks, in some embodiments.

公开(公告)号：US20230099463A1

公开(公告)日：2023-03-30

申请号：US17945216

申请日：2022-09-15

Applicant: Apple Inc.

Inventor： Hongyu Xu ,  Feng Tang ,  Kai Kang

IPC: G06F30/13

Abstract: Various implementations provide a 3D floor plan based on scanning a room and detecting windows, doors, and openings using 2D orthographic projection. Points of a dense set of points (e.g., a dense point cloud) that are close to a plane representing a wall are projected onto the plane and used to identify windows, doors, and opening on the wall. Representations of the detected windows, doors, and openings may then be positioned in a 3D floor plan based on the known position of the wall within the corresponding room, i.e., the location of the wall plane relative to the dense point cloud is known. Other aspects of a 3D floor plan may be detected directly from points of a dense 3D point cloud, windows, doors, and openings may be detected indirectly using projections of the points of the 3D point cloud onto a 2D plane, and the detected aspects may be combined into a single 3D floor plan.

公开(公告)号：US11163981B2

公开(公告)日：2021-11-02

申请号：US16277282

申请日：2019-02-15

Applicant: Apple Inc.

Inventor： Joshua M. Susskind ,  Walter A. Talbott ,  Shih-Yu Sun ,  Feng Tang

IPC: G06K9/00 ,  G06K9/32

Abstract: A facial recognition authentication process operating on a device may capture an image of a user using a camera on the device. The facial recognition authentication process may include operating a full face facial recognition authentication process on the captured image or operating a partial face facial recognition authentication process on the captured image. The process may determine which process to operate (either full face or partial face) based on an assessment of an amount of occlusion in the captured image. The partial face facial recognition authentication process may be operated when there is at least some occlusion of selected features (e.g., nose and/or mouth) on the user's face in the captured image.

公开(公告)号：US11010905B2

公开(公告)日：2021-05-18

申请号：US16428688

申请日：2019-05-31

Applicant: Apple Inc.

Inventor： Afshin Dehghan ,  Yang Yang ,  Feng Tang ,  Kelsey Y. Ho

IPC: G06T7/246 ,  G06T7/70

Abstract: Techniques described herein provide efficient object detection and tracking in video images, such as may be used for real-time camera control in power-limited mobile image capture devices. The techniques include performing object detection on a first subset of frames of an input video, detecting an object and object location in a first detection frame of the first subset of frames, and tracking the detected object on a second subset of frames of the input video after the first detection frame.