-
公开(公告)号:US20250036206A1
公开(公告)日:2025-01-30
申请号:US18761848
申请日:2024-07-02
Applicant: Apple Inc.
Inventor: Daniel J. Brewer , Yirong Tang , Chase B. Lortie
Abstract: Various implementations track hand motion to interpret a scroll movement. For example, an example process may include obtaining sensor data associated with a hand via one or more sensors in a physical environment. The process may further include determining positional data corresponding to three-dimensional (3D) positions of two points on the hand based on the sensor data. The process may further include determining whether a movement of the hand includes a wrist rotation associated with the hand rotating about the wrist, an arm motion associated with movement of the arm, or a combination of the wrist rotation and the arm motion. The process may further include determining the movement of the hand as a user interaction event based on the positional data and whether the movement of the hand includes the wrist rotation, the arm motion, or a combination of the wrist rotation and the arm motion.
-
公开(公告)号:US20240402826A1
公开(公告)日:2024-12-05
申请号:US18675796
申请日:2024-05-28
Applicant: Apple Inc.
Inventor: Daniel J. Brewer , Chase B. Lortie , David J. Meyer , Julian K. Shutzberg , Tian Qiu , Yirong Tang
IPC: G06F3/01
Abstract: Processing gesture input includes obtaining hand tracking data for a hand from one or more sensors, wherein the hand performs a pinch in the hand tracking data, determining a hand position and a hand orientation for the hand from the hand tracking data, applying a predefined offset from the hand position based on the hand orientation to determine a pinch centroid, and determining an input location based on the pinch centroid. The pinch centroid is used in an indirect motion mapping pipeline to determine characteristics of user input based on user motion.
-
公开(公告)号:US20240402800A1
公开(公告)日:2024-12-05
申请号:US18676786
申请日:2024-05-29
Applicant: Apple Inc.
Inventor: Julian K. Shutzberg , David J. Meyer , David M. Teitelbaum , Mehmet N. Agaoglu , Ian R. Fasel , Chase B. Lortie , Daniel J. Brewer , Tim H. Cornelissen , Leah M. Gum , Alexander G. Berardino , Lorenzo Soto Doblado , Vinay Chawda , Itay Bar Yosef , Dror Irony , Eslam A. Mostafa , Guy Engelhard , Paul A. Lacey , Ashwin Kumar Asoka Kumar Shenoi , Bhavin Vinodkumar Nayak , Liuhao Ge , Lucas Soffer , Victor Belyaev , Bharat C. Dandu , Matthias M. Schroeder , Yirong Tang
IPC: G06F3/01 , G06F3/04815
Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.
-
公开(公告)号:US20240402825A1
公开(公告)日:2024-12-05
申请号:US18675723
申请日:2024-05-28
Applicant: Apple Inc.
Inventor: Daniel J. Brewer , Bharat C. Dandu , David J. Meyer , Julian K. Shutzberg , Lucas Soffer , Yirong Tang
IPC: G06F3/01
Abstract: Processing gesture input includes obtaining hand tracking data for a first hand based on one or more camera frames, detecting a first input gesture by the first hand based on the hand tracking data, and determining whether the first hand is in an active state. An input action associated with the first gesture is initiated in accordance with a determination that the first hand is in the active state. If, while the hand is in an active state, a determination is made that the inactive criterion is satisfied, then the first hand is transitioned to an inactive state.
-
公开(公告)号:US20240385692A1
公开(公告)日:2024-11-21
申请号:US18641711
申请日:2024-04-22
Applicant: Apple Inc.
Inventor: Julian K. Shutzberg , Bharat C. Dandu , Daniel J. Brewer
IPC: G06F3/01 , G06F3/04815 , G06F3/04845
Abstract: Devices, systems, and methods that interpret user activity, such as two hand gestures, as user interactions with virtual elements positioned within a three-dimensional (3D) space. For example, an example process may include receiving data corresponding to user activity involving two hands in a 3D coordinate system. The process may further include identifying actions performed by the two hands based on the data corresponding to the user activity, each of the two hands performing one of the identified actions. The process may further include determining whether the identified actions satisfy a criterion for a gesture type based on the data corresponding to the user activity. The process may further include interpreting the identified actions based on a reference element corresponding to the gesture type, wherein different gesture types correspond to different reference elements in accordance with determining that the identified actions satisfy the criterion for the gesture type.
-
公开(公告)号:US20240103634A1
公开(公告)日:2024-03-28
申请号:US18472724
申请日:2023-09-22
Applicant: Apple Inc.
Inventor: Vinay Chawda , Chase B. Lortie , Daniel J. Brewer , Julian K. Shutzberg , Leah M. Gum , Yirong Tang , Alexander T. Wing
IPC: G06F3/01
CPC classification number: G06F3/017
Abstract: Techniques for mapping a user input motion includes detecting an input motion by a user, determining an origin for an input motion in a user-centric spherical coordinate system, determining an arc length for the input motion based on the determined origin, mapping the arc length of the input motion to a 2D plane of a user input component, and presenting a movement of a user input component on the 2D plane in accordance with the mapping.
-
公开(公告)号:US20240402821A1
公开(公告)日:2024-12-05
申请号:US18375280
申请日:2023-09-29
Applicant: Apple Inc.
Inventor: David J. Meyer , Julian K. Shutzberg , David M. Teitelbaum , Daniel J. Brewer , Bharat C. Dandu , Christopher D. McKenzie
IPC: G06F3/01
Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.
-
公开(公告)号:US20240331447A1
公开(公告)日:2024-10-03
申请号:US18478197
申请日:2023-09-29
Applicant: Apple Inc.
Inventor: Itay Bar Yosef , Bhavin Vinodkumar Nayak , Chao-Ming Yen , Chase B. Lortie , Daniel J. Brewer , Dror Irony , Eslam A. Mostafa , Guy Engelhard , Ian R. Fasel , Julian K. Shutzberg , Liuhao Ge , Lucas Soffer , Matthias M. Schroeder , Mohammadhadi Kiapour , Victor Belyaev , Yirong Tang
Abstract: Processing gesture input includes obtaining hand tracking data based on a set of camera frames, determining a hand pose based on the hand tracking data, and determining an intentionality classification for a gesture based on the hand pose. An input action corresponding to the gesture is enabled based on the hand pose and the intentionality classification. An occlusion classification is determined for the hand based on the hand pose and the input gesture can be determined based on the occlusion classification.
-
9.
公开(公告)号:US20240103635A1
公开(公告)日:2024-03-28
申请号:US18472818
申请日:2023-09-22
Applicant: Apple Inc.
Inventor: Daniel J. Brewer , Ashwin Kumar Asoka Kumar Shenoi , Tian Qiu , Leah M. Gum , David J. Meyer , Julian K. Shutzberg , Yirong Tang
IPC: G06F3/01 , G06V10/764 , G06V40/20
CPC classification number: G06F3/017 , G06V10/764 , G06V40/28
Abstract: Suppressing a hand gesture upon detecting peripheral events on a peripheral device includes determining a first hand pose for a first hand a second hand pose for a second hand in response to a detected peripheral device peripheral event, determining, based on the first hand pose and the second hand pose, at least one hand of the first hand and the second hand in a peripheral use mode, detecting an input gesture from a hand of the at least one hand determined to be in the peripheral use mode, and rejecting the input gesture by a user input pipeline in accordance with the determination that the hand is in the peripheral use mode. The presence of a peripheral device is confirmed by activating a computer vision system in response to determining that a peripheral use condition is satisfied.
-
公开(公告)号:US12229344B2
公开(公告)日:2025-02-18
申请号:US18478183
申请日:2023-09-29
Applicant: Apple Inc.
Inventor: Victor Belyaev , Bhavin Vinodkumar Nayak , Daniel J. Brewer , Itay Bar Yosef , Julian K. Shutzberg , Matthias M. Schroeder
Abstract: Enabling gesture input includes obtaining hand tracking data based on one or more camera frames, detecting a contact event between a first finger and a second finger based on the hand tracking data, and determining a first contact location on the first finger and a second contact location on the second finger. In accordance with a determination that the first contact location and the second contact location are within a first predefined gesture zone for a first gesture, an input action is enabled corresponding to the first gesture.
-
-
-
-
-
-
-
-
-