公开(公告)号：US20240402792A1

公开(公告)日：2024-12-05

申请号：US18666132

申请日：2024-05-16

Applicant: Apple Inc.

Inventor： Jack H. Lawrence ,  Mark A. Ebbole ,  Evgenii Krivoruchko

IPC: G06F3/01 ,  G06F3/0481 ,  G06T19/00

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable multi-mode interactions with elements in a three-dimensional (3D) environment based on cursor movement associated with tracking user hand motion. For example, a process may include presenting an extended reality (XR) environment comprising a virtual element and a cursor. The process may further include obtaining hand data corresponding to 3D movement of a hand in a 3D environment. The process may further include operating in first mode where the 3D motion of the hand is converted to two-dimensional (2D) motion and detecting a 3D user input criteria. In response to the 3D user input criteria a mode of operation is modified to a second mode where the 3D motion of the hand is maintained without conversion to the 2D motion.