公开(公告)号：US20240331447A1

公开(公告)日：2024-10-03

申请号：US18478197

申请日：2023-09-29

Applicant: Apple Inc.

Inventor： Itay Bar Yosef ,  Bhavin Vinodkumar Nayak ,  Chao-Ming Yen ,  Chase B. Lortie ,  Daniel J. Brewer ,  Dror Irony ,  Eslam A. Mostafa ,  Guy Engelhard ,  Ian R. Fasel ,  Julian K. Shutzberg ,  Liuhao Ge ,  Lucas Soffer ,  Matthias M. Schroeder ,  Mohammadhadi Kiapour ,  Victor Belyaev ,  Yirong Tang

IPC: G06V40/20 ,  G06F3/01 ,  G06T7/70

CPC classification number: G06V40/28 ,  G06F3/013 ,  G06F3/017 ,  G06T7/70

Abstract: Processing gesture input includes obtaining hand tracking data based on a set of camera frames, determining a hand pose based on the hand tracking data, and determining an intentionality classification for a gesture based on the hand pose. An input action corresponding to the gesture is enabled based on the hand pose and the intentionality classification. An occlusion classification is determined for the hand based on the hand pose and the input gesture can be determined based on the occlusion classification.

公开(公告)号：US20240402800A1

公开(公告)日：2024-12-05

申请号：US18676786

申请日：2024-05-29

Applicant: Apple Inc.

Inventor： Julian K. Shutzberg ,  David J. Meyer ,  David M. Teitelbaum ,  Mehmet N. Agaoglu ,  Ian R. Fasel ,  Chase B. Lortie ,  Daniel J. Brewer ,  Tim H. Cornelissen ,  Leah M. Gum ,  Alexander G. Berardino ,  Lorenzo Soto Doblado ,  Vinay Chawda ,  Itay Bar Yosef ,  Dror Irony ,  Eslam A. Mostafa ,  Guy Engelhard ,  Paul A. Lacey ,  Ashwin Kumar Asoka Kumar Shenoi ,  Bhavin Vinodkumar Nayak ,  Liuhao Ge ,  Lucas Soffer ,  Victor Belyaev ,  Bharat C. Dandu ,  Matthias M. Schroeder ,  Yirong Tang

IPC: G06F3/01 ,  G06F3/04815

Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.