公开(公告)号：US11348316B2

公开(公告)日：2022-05-31

申请号：US16549483

申请日：2019-08-23

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Bruno M. Sommer ,  Timothy R. Oriol

IPC: G06T19/00 ,  G06T19/20 ,  G02B27/01

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute (e.g., surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.

公开(公告)号：US20210279966A1

公开(公告)日：2021-09-09

申请号：US17177458

申请日：2021-02-17

Applicant: Apple, Inc.

Inventor： Aaron M. Burns ,  Alexis H. Palangie ,  Nathan Gitter ,  Pol Pla I. Conesa

IPC: G06T19/00 ,  G06T19/20 ,  G06F3/0481

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable presenting environments comprising visual representations of multiple applications. In one implementation, a method includes presenting a view of an environment at an electronic device on a display of the electronic device. The environment comprising visual representations corresponding to a plurality of applications. A first application among the plurality of applications is designated as an elevated application. The elevated application is provided with access to a control parameter configured to modify an ambience of the environment. Other applications of the plurality of applications are restricted from accessing the control parameter while the first application is designated as the elevated application.

公开(公告)号：US20250118034A1

公开(公告)日：2025-04-10

申请号：US18983743

申请日：2024-12-17

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Bruno M. Sommer ,  Timothy R. Oriol

IPC: H04N13/122 ,  H04N13/293 ,  H04N13/361 ,  H04N13/398

Abstract: Various implementations disclosed herein include devices, systems, and methods that enable a device to provide a view of virtual elements and a physical environment where the presentation of the virtual elements is based on positioning relative to the physical environment. In one example, a device is configured to detect a change in positioning of a virtual element, for example, when a virtual element is added, moved, or the physical environment around the virtual element is changed. The location of the virtual element in the physical environment is used to detect an attribute of the physical environment upon which the presentation of the virtual element depends. Thus, the device is further configured to detect an attribute (e.g., surface, table, mid-air, etc.) of the physical environment based on the placement of the virtual element and present the virtual element based on the detected attribute.

公开(公告)号：US12189853B2

公开(公告)日：2025-01-07

申请号：US18601376

申请日：2024-03-11

Applicant: Apple Inc.

Inventor： Adam G Poulos ,  Aaron M. Burns ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

Abstract: A method includes displaying a plurality of computer-generated objects, and obtaining finger manipulation data from a finger-wearable device via a communication interface. In some implementations, the method includes receiving an untethered input vector that includes a plurality of untethered input indicator values. Each of the plurality of untethered input indicator values is associated with one of a plurality of untethered input modalities. In some implementations, the method includes obtaining proxy object manipulation data from a physical proxy object via the communication interface. The proxy object manipulation data corresponds to sensor data associated with one or more sensors integrated in the physical proxy object. The method includes registering an engagement event with respect to a first one of the plurality of computer-generated objects based on a combination of the finger manipulation data, the untethered input vector, and the proxy object manipulation data.

公开(公告)号：US20250004581A1

公开(公告)日：2025-01-02

申请号：US18576654

申请日：2022-07-01

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Anette L. Freiin von Kapri ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky ,  Christopher L. Nolet ,  David M. Schattel ,  Samantha Koire

IPC: G06F3/038 ,  G06F3/01 ,  G06F3/0346 ,  G06V20/20

Abstract: In one implementation. a method for dynamically selecting an operation modality for a physical object. The method includes: obtaining a user input vector that includes at least one user input indicator value associated with one of a plurality of different input modalities; obtaining tracking data associated with a physical object; generating a first characterization vector for the physical object, including a pose value and a user grip value, based on the user input vector and the tracking data, wherein the pose value characterizes a spatial relationship between the physical object and a user of the computing system and the user grip value characterizes a manner in which the physical object is being held by the user; and selecting, based on the first characterization vector, a first operation modality as a current operation modality for the physical object.

公开(公告)号：US12118182B2

公开(公告)日：2024-10-15

申请号：US18153198

申请日：2023-01-11

Applicant: Apple Inc.

Inventor： Aaron M. Burns ,  Scott M. Andrus ,  David M. Schattel

IPC: G06F3/048 ,  G06F3/01 ,  G06F3/04815 ,  G06F3/0482

CPC classification number: G06F3/0482 ,  G06F3/013 ,  G06F3/04815

Abstract: In accordance with some embodiments, an exemplary process for controlling the generation and display of suggested additional content based on a context of a workspace is described.

公开(公告)号：US20240193858A1

公开(公告)日：2024-06-13

申请号：US18286527

申请日：2022-04-11

Applicant: Apple Inc.

Inventor： Benjamin Hylak ,  Aaron M. Burns ,  Grant H. Mulliken ,  Mary A. Pyc ,  Nathan Gitter ,  Pau Sastre Miguel ,  Steven A. Marchette

IPC: G06T17/00 ,  G06V40/16 ,  G06V40/20 ,  H04N13/388

CPC classification number: G06T17/00 ,  G06V40/174 ,  G06V40/20 ,  H04N13/388

Abstract: In one implementation, a method of assisting in the rehearsal of a presentation is performed at a device including a display, one or more processors, and non-transitory memory. The method includes obtaining a difficulty level for a rehearsal of a presentation. The method includes displaying, on the display, one or more slides of the presentation. The method includes displaying, on the display in association with a volumetric environment, one or more virtual objects based on the difficulty level.

公开(公告)号：US11966510B2

公开(公告)日：2024-04-23

申请号：US18114492

申请日：2023-02-27

Applicant: Apple Inc.

Inventor： Adam G. Poulos ,  Aaron M. Burns ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky ,  Nicolai Georg

IPC: G06F3/01

CPC classification number: G06F3/014 ,  G06F3/013 ,  G06F3/017

Abstract: A method includes displaying a plurality of computer-generated objects, and obtaining finger manipulation data from a finger-wearable device via a communication interface. In some implementations, the method includes receiving an untethered input vector that includes a plurality of untethered input indicator values. Each of the plurality of untethered input indicator values is associated with one of a plurality of untethered input modalities. In some implementations, the method includes obtaining proxy object manipulation data from a physical proxy object via the communication interface. The proxy object manipulation data corresponds to sensor data associated with one or more sensors integrated in the physical proxy object. The method includes registering an engagement event with respect to a first one of the plurality of computer-generated objects based on a combination of the finger manipulation data, the untethered input vector, and the proxy object manipulation data.

公开(公告)号：US20230333645A1

公开(公告)日：2023-10-19

申请号：US18196882

申请日：2023-05-12

Applicant: Apple Inc.

Inventor： Alexis H. Palangie ,  Aaron M. Burns ,  Arun Rakesh Yoganandan ,  Benjamin R. Blachnitzky

IPC: G06F3/01 ,  G06F3/14 ,  G06F3/0354 ,  G06F3/0488 ,  G06F3/038 ,  G06F3/0481

CPC classification number: G06F3/013 ,  G06F3/1423 ,  G06F3/03547 ,  G06F3/0488 ,  G06F3/038 ,  G06F3/0481 ,  G06F2203/0381

Abstract: In one implementation, a method of processing input for multiple devices is performed by a first electronic device one or more processors and non-transitory memory. The method includes determining a gaze direction. The method includes selecting a target electronic device based on determining that the gaze direction is directed to the target electronic device. The method includes receiving, via an input device, one or more inputs. The method includes processing the one or more inputs based on the target electronic device.

公开(公告)号：US20230325047A1

公开(公告)日：2023-10-12

申请号：US18121673

申请日：2023-03-15

Applicant: Apple Inc.

Inventor： Nicolai Georg ,  Aaron M. Burns ,  Adam G. Poulos ,  Arun Rakesh Yoganandan ,  Benjamin Hylak ,  Benjamin R. Blachnitzky

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/0486

CPC classification number: G06F3/04815 ,  G06F3/014 ,  G06F3/0486 ,  G06F2203/0331 ,  G06F2203/04802

Abstract: A method includes displaying a plurality of computer-generated objects, including a first computer-generated object at a first position within an environment and a second computer-generated object at a second position within the environment. The first computer-generated object corresponds to a first user interface element that includes a first set of controls for modifying a content item. The method includes, while displaying the plurality of computer-generated objects, obtaining extremity tracking data. The method includes moving the first computer-generated object from the first position to a third position within the environment based on the extremity tracking data. The method includes, in accordance with a determination that the third position satisfies a proximity threshold with respect to the second position, merging the first computer-generated object with the second computer-generated object in order to generate a third computer-generated object for modifying the content item. The method includes displaying the third computer-generated object.