公开(公告)号：US12242668B2

公开(公告)日：2025-03-04

申请号：US18123762

申请日：2023-03-20

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.

公开(公告)号：US12158988B2

公开(公告)日：2024-12-03

申请号：US18114447

申请日：2023-02-27

Applicant: Apple Inc.

Inventor： Adam G. Poulos ,  Aaron M. Burns ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, and an extremity tracker. The method includes obtaining extremity tracking data via the extremity tracker. The method includes displaying a computer-generated representation of a trackpad that is spatially associated with a physical surface. The physical surface is viewable within the display along with a content manipulation region that is separate from the computer-generated representation of the trackpad. The method includes identifying a first location within the computer-generated representation of the trackpad based on the extremity tracking data. The method includes mapping the first location to a corresponding location within the content manipulation region. The method includes displaying an indicator indicative of the mapping. The indicator may overlap the corresponding location within the content manipulation region.

公开(公告)号：US20240231486A1

公开(公告)日：2024-07-11

申请号：US18613570

申请日：2024-03-22

Applicant: Apple Inc.

Inventor： Anette L. Freiin von Kapri ,  Aaron M. Burns ,  Benjamin R. Blachnitsky

IPC: G06F3/01 ,  G06F3/0346 ,  G06F3/038 ,  G06V40/10

CPC classification number: G06F3/013 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/038 ,  G06V40/10

Abstract: A method includes determining a first gaze position within a content manipulation region based on eye tracking data from an eye tracker. The method includes determining a selection point associated with a physical surface, based on spatial selector data from a spatial selector tracker. The method includes displaying a computer-generated representation of a trackpad on the physical surface, based on the first gaze position and the selection point. In some implementations, a method includes displaying a user interface including a plurality of content manipulation regions, a plurality of affordances respectively associated with the plurality of content manipulation regions, and a computer-generated representation of a trackpad. The method includes detecting, via a spatial selector tracker, an input directed to a first affordance associated with a first content manipulation region. The method includes associating the computer-generated representation of the trackpad with the first content manipulation region, based on the input.

公开(公告)号：US11995301B2

公开(公告)日：2024-05-28

申请号：US18182304

申请日：2023-03-10

Applicant: Apple Inc.

Inventor： Benjamin Hylak ,  Alexis H. Palangie ,  Jordan A. Cazamias ,  Nathan Gitter ,  Aaron M. Burns

IPC: G06F3/04845 ,  G06F3/01 ,  G06F3/0482

CPC classification number: G06F3/04845 ,  G06F3/013 ,  G06F3/0482

Abstract: Methods for displaying user interfaces in a computer-generated environment provide for an efficient and intuitive user experience. In some embodiments, user interfaces can have different immersion levels. In some embodiments, a user interface can have a respective immersion level based on its location in the three-dimensional environment or distance from the user. In some embodiments, a user interface can have a respective immersion level based on the state of the user interface. In some embodiments, a user interface can switch from one immersion level to another in response to the user's interaction with the user interface.

公开(公告)号：US20230333651A1

公开(公告)日：2023-10-19

申请号：US18123762

申请日：2023-03-20

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

CPC classification number: G06F3/014 ,  G06F3/017

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.

公开(公告)号：US20230333644A1

公开(公告)日：2023-10-19

申请号：US18123837

申请日：2023-03-20

Applicant: Apple Inc.

Inventor： Jordan A. Cazamias ,  Aaron M. Burns ,  David M. Schattel ,  Jonathan Perron ,  Jonathan Ravasz ,  Shih-Sang Chiu

IPC: G06F3/16 ,  G06F3/01

CPC classification number: G06F3/013 ,  G06F3/017 ,  G06F3/167

Abstract: Various implementations disclosed herein include devices, systems, and methods for organizing virtual objects within an environment. In some implementations, a method includes obtaining a user input corresponding to a command to associate a virtual object with a region of an environment. A gaze input corresponding to a user focus location in the region is detected. A movement of the virtual object to an object placement location proximate the user focus location is displayed.

公开(公告)号：US20250165070A1

公开(公告)日：2025-05-22

申请号：US19027964

申请日：2025-01-17

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

Abstract: A method is performed at an electronic device with one or more processors, a non-transitory memory, a display, an extremity tracking system, and a communication interface provided to communicate with a finger-wearable device. The method includes displaying a computer-generated object on the display. The method includes obtaining finger manipulation data from the finger-wearable device via the communication interface. The method includes determining a multi-finger gesture based on extremity tracking data from the extremity tracking system and the finger manipulation data. The method includes registering an engagement event with respect to the computer-generated object according to the multi-finger gesture.

公开(公告)号：US12211152B2

公开(公告)日：2025-01-28

申请号：US17727311

申请日：2022-04-22

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Bruno M. Sommer ,  Timothy R. Oriol

IPC: G06T19/00 ,  G02B27/01 ,  G06T19/20

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute (e.g., surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.

公开(公告)号：US12008208B2

公开(公告)日：2024-06-11

申请号：US18121673

申请日：2023-03-15

Applicant: Apple Inc.

Inventor： Nicolai Georg ,  Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky

IPC: G06F17/00 ,  G06F3/01 ,  G06F3/04815 ,  G06F3/0486

CPC classification number: G06F3/04815 ,  G06F3/014 ,  G06F3/0486 ,  G06F2203/0331 ,  G06F2203/04802

Abstract: A method includes displaying a plurality of computer-generated objects, including a first computer-generated object at a first position within an environment and a second computer-generated object at a second position within the environment. The first computer-generated object corresponds to a first user interface element that includes a first set of controls for modifying a content item. The method includes, while displaying the plurality of computer-generated objects, obtaining extremity tracking data. The method includes moving the first computer-generated object from the first position to a third position within the environment based on the extremity tracking data. The method includes, in accordance with a determination that the third position satisfies a proximity threshold with respect to the second position, merging the first computer-generated object with the second computer-generated object in order to generate a third computer-generated object for modifying the content item. The method includes displaying the third computer-generated object.

公开(公告)号：US11960657B2

公开(公告)日：2024-04-16

申请号：US18124120

申请日：2023-03-21

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky ,  Jordan A. Cazamias ,  Nicolai Georg

IPC: G06F3/0346 ,  G06F3/01 ,  G06F3/038 ,  G06F3/0486 ,  G06T7/20

CPC classification number: G06F3/017 ,  G06F3/014 ,  G06F3/0346 ,  G06F3/038 ,  G06F3/0486 ,  G06T7/20 ,  G06F2203/0331 ,  G06T2207/30196

Abstract: A method includes, while displaying a computer-generated object at a first position within an environment, obtaining extremity tracking data from an extremity tracker. The first position is outside of a drop region that is viewable using the display. The method includes moving the computer-generated object from the first position to a second position within the environment based on the extremity tracking data. The method includes, in response to determining that the second position satisfies a proximity threshold with respect to the drop region, detecting an input that is associated with a spatial region of the environment. The method includes moving the computer-generated object from the second position to a third position that is within the drop region, based on determining that the spatial region satisfies a focus criterion associated with the drop region.