-
公开(公告)号:US20240402801A1
公开(公告)日:2024-12-05
申请号:US18731143
申请日:2024-05-31
Applicant: Apple Inc.
Inventor: Julian K. Shutzberg , David J. Meyer , David M. Teitelbaum
IPC: G06F3/01 , G06F3/04815 , G06F3/0487 , G06F9/451
Abstract: Devices, systems, and methods that interpret user activity as user interactions with virtual elements (e.g., UI elements) positioned within in a 3D space such as an XR environment. Some implementations use an architecture that receives application UI geometry in a system or shared simulation area and outputs interaction events data (e.g., less than all user activity data) for an application to use to recognize input to the application. An OS process may be configured to provide an input support process to support recognizing input intended for one or more separately-executing applications, for example, by providing some input recognition tasks to recognize user activity as input for the applications or by converting user activity data into a format that can be more easily, accurately, efficiently, or effectively interpreted by the applications and/or in a way that facilitates preservation of user privacy.
-
公开(公告)号:US20240402800A1
公开(公告)日:2024-12-05
申请号:US18676786
申请日:2024-05-29
Applicant: Apple Inc.
Inventor: Julian K. Shutzberg , David J. Meyer , David M. Teitelbaum , Mehmet N. Agaoglu , Ian R. Fasel , Chase B. Lortie , Daniel J. Brewer , Tim H. Cornelissen , Leah M. Gum , Alexander G. Berardino , Lorenzo Soto Doblado , Vinay Chawda , Itay Bar Yosef , Dror Irony , Eslam A. Mostafa , Guy Engelhard , Paul A. Lacey , Ashwin Kumar Asoka Kumar Shenoi , Bhavin Vinodkumar Nayak , Liuhao Ge , Lucas Soffer , Victor Belyaev , Bharat C. Dandu , Matthias M. Schroeder , Yirong Tang
IPC: G06F3/01 , G06F3/04815
Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.
-
公开(公告)号:US20240411444A1
公开(公告)日:2024-12-12
申请号:US18810881
申请日:2024-08-21
Applicant: APPLE INC.
Inventor: Julian K. Shutzberg , David M. Teitelbaum , Chase B. Lortie , David J. Meyer , Lorenzo Soto Doblado
IPC: G06F3/0487 , G06F3/01 , G06F3/04815 , G06F3/04842
Abstract: Various implementations disclosed herein include devices, systems, and methods that associate user activities with user interface (UI) elements within a 3D environment. Some implementations do so in ways that account for inaccuracies (i.e., fuzziness) in sensor-based detection of the user activities, e.g., inaccuracy in sensor data-based gaze tracking or sensor data-based hand/joint position. Some implementations use a sampling technique to associate user activity in a 3D environment with an appropriate portion of a UI positioned within a 3D environment. For example, a sampling technique may be used to identify sample locations within the 3D environment (e.g., sample locations around a gaze direction) to evaluate and ultimately select from to associate with a user activity, e.g., associating a particular UI button with a gaze direction.
-
公开(公告)号:US20240402821A1
公开(公告)日:2024-12-05
申请号:US18375280
申请日:2023-09-29
Applicant: Apple Inc.
Inventor: David J. Meyer , Julian K. Shutzberg , David M. Teitelbaum , Daniel J. Brewer , Bharat C. Dandu , Christopher D. McKenzie
IPC: G06F3/01
Abstract: Various implementations disclosed herein include devices, systems, and methods that interpret user activity as user interactions with user interface (UI) elements positioned within a three-dimensional (3D) space such as an extended reality (XR) environment. Some implementations enable user interactions with virtual elements displayed in 3D environments that utilize alternative input modalities, e.g., XR environments that interpret user activity as either direct interactions or indirect interactions with virtual elements.
-
-
-