公开(公告)号：US20240402800A1

公开(公告)日：2024-12-05

申请号：US18676786

申请日：2024-05-29

Applicant: Apple Inc.

Inventor： Julian K. Shutzberg ,  David J. Meyer ,  David M. Teitelbaum ,  Mehmet N. Agaoglu ,  Ian R. Fasel ,  Chase B. Lortie ,  Daniel J. Brewer ,  Tim H. Cornelissen ,  Leah M. Gum ,  Alexander G. Berardino ,  Lorenzo Soto Doblado ,  Vinay Chawda ,  Itay Bar Yosef ,  Dror Irony ,  Eslam A. Mostafa ,  Guy Engelhard ,  Paul A. Lacey ,  Ashwin Kumar Asoka Kumar Shenoi ,  Bhavin Vinodkumar Nayak ,  Liuhao Ge ,  Lucas Soffer ,  Victor Belyaev ,  Bharat C. Dandu ,  Matthias M. Schroeder ,  Yirong Tang

IPC: G06F3/01 ,  G06F3/04815

Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.

公开(公告)号：US20240402825A1

公开(公告)日：2024-12-05

申请号：US18675723

申请日：2024-05-28

Applicant: Apple Inc.

Inventor： Daniel J. Brewer ,  Bharat C. Dandu ,  David J. Meyer ,  Julian K. Shutzberg ,  Lucas Soffer ,  Yirong Tang

IPC: G06F3/01

Abstract: Processing gesture input includes obtaining hand tracking data for a first hand based on one or more camera frames, detecting a first input gesture by the first hand based on the hand tracking data, and determining whether the first hand is in an active state. An input action associated with the first gesture is initiated in accordance with a determination that the first hand is in the active state. If, while the hand is in an active state, a determination is made that the inactive criterion is satisfied, then the first hand is transitioned to an inactive state.

公开(公告)号：US20240331447A1

公开(公告)日：2024-10-03

申请号：US18478197

申请日：2023-09-29

Applicant: Apple Inc.

Inventor： Itay Bar Yosef ,  Bhavin Vinodkumar Nayak ,  Chao-Ming Yen ,  Chase B. Lortie ,  Daniel J. Brewer ,  Dror Irony ,  Eslam A. Mostafa ,  Guy Engelhard ,  Ian R. Fasel ,  Julian K. Shutzberg ,  Liuhao Ge ,  Lucas Soffer ,  Matthias M. Schroeder ,  Mohammadhadi Kiapour ,  Victor Belyaev ,  Yirong Tang

IPC: G06V40/20 ,  G06F3/01 ,  G06T7/70

CPC classification number: G06V40/28 ,  G06F3/013 ,  G06F3/017 ,  G06T7/70

Abstract: Processing gesture input includes obtaining hand tracking data based on a set of camera frames, determining a hand pose based on the hand tracking data, and determining an intentionality classification for a gesture based on the hand pose. An input action corresponding to the gesture is enabled based on the hand pose and the intentionality classification. An occlusion classification is determined for the hand based on the hand pose and the input gesture can be determined based on the occlusion classification.