公开(公告)号：US20240331447A1

公开(公告)日：2024-10-03

申请号：US18478197

申请日：2023-09-29

Applicant: Apple Inc.

Inventor： Itay Bar Yosef ,  Bhavin Vinodkumar Nayak ,  Chao-Ming Yen ,  Chase B. Lortie ,  Daniel J. Brewer ,  Dror Irony ,  Eslam A. Mostafa ,  Guy Engelhard ,  Ian R. Fasel ,  Julian K. Shutzberg ,  Liuhao Ge ,  Lucas Soffer ,  Matthias M. Schroeder ,  Mohammadhadi Kiapour ,  Victor Belyaev ,  Yirong Tang

IPC: G06V40/20 ,  G06F3/01 ,  G06T7/70

CPC classification number: G06V40/28 ,  G06F3/013 ,  G06F3/017 ,  G06T7/70

Abstract: Processing gesture input includes obtaining hand tracking data based on a set of camera frames, determining a hand pose based on the hand tracking data, and determining an intentionality classification for a gesture based on the hand pose. An input action corresponding to the gesture is enabled based on the hand pose and the intentionality classification. An occlusion classification is determined for the hand based on the hand pose and the input gesture can be determined based on the occlusion classification.

公开(公告)号：US20240402800A1

公开(公告)日：2024-12-05

申请号：US18676786

申请日：2024-05-29

Applicant: Apple Inc.

Inventor： Julian K. Shutzberg ,  David J. Meyer ,  David M. Teitelbaum ,  Mehmet N. Agaoglu ,  Ian R. Fasel ,  Chase B. Lortie ,  Daniel J. Brewer ,  Tim H. Cornelissen ,  Leah M. Gum ,  Alexander G. Berardino ,  Lorenzo Soto Doblado ,  Vinay Chawda ,  Itay Bar Yosef ,  Dror Irony ,  Eslam A. Mostafa ,  Guy Engelhard ,  Paul A. Lacey ,  Ashwin Kumar Asoka Kumar Shenoi ,  Bhavin Vinodkumar Nayak ,  Liuhao Ge ,  Lucas Soffer ,  Victor Belyaev ,  Bharat C. Dandu ,  Matthias M. Schroeder ,  Yirong Tang

IPC: G06F3/01 ,  G06F3/04815

Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.

公开(公告)号：US12229344B2

公开(公告)日：2025-02-18

申请号：US18478183

申请日：2023-09-29

Applicant: Apple Inc.

Inventor： Victor Belyaev ,  Bhavin Vinodkumar Nayak ,  Daniel J. Brewer ,  Itay Bar Yosef ,  Julian K. Shutzberg ,  Matthias M. Schroeder

IPC: G06F3/01 ,  G06T7/215 ,  G06T7/246 ,  G06T7/60 ,  G06V40/20

Abstract: Enabling gesture input includes obtaining hand tracking data based on one or more camera frames, detecting a contact event between a first finger and a second finger based on the hand tracking data, and determining a first contact location on the first finger and a second contact location on the second finger. In accordance with a determination that the first contact location and the second contact location are within a first predefined gesture zone for a first gesture, an input action is enabled corresponding to the first gesture.

公开(公告)号：US20240402823A1

公开(公告)日：2024-12-05

申请号：US18478183

申请日：2023-09-29

Applicant: Apple Inc.

Inventor： Victor Belyaev ,  Bhavin Vinodkumar Nayak ,  Daniel J. Brewer ,  Itay Bar Yosef ,  Julian K. Shutzberg ,  Matthias M. Schroeder

IPC: G06F3/01 ,  G06T7/215 ,  G06T7/246 ,  G06T7/60 ,  G06V40/20

Abstract: Enabling gesture input includes obtaining hand tracking data based on one or more camera frames, detecting a contact event between a first finger and a second finger based on the hand tracking data, and determining a first contact location on the first finger and a second contact location on the second finger. In accordance with a determination that the first contact location and the second contact location are within a first predefined gesture zone for a first gesture, an input action is enabled corresponding to the first gesture.