公开(公告)号：US20220058847A1

公开(公告)日：2022-02-24

申请号：US17275046

申请日：2019-09-24

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Cameron J. Dunn ,  John C. Russell

IPC: G06T13/40 ,  G06F3/01 ,  G06T7/73 ,  G06T7/10

Abstract: In some implementations, a method is performed by a device including a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, the method includes obtaining user movement information. In some implementations, the user movement information characterizes a first body pose of the user at a first time and a second body pose of the user at a second time. In some implementations, the method includes determining whether a transition from the first body pose to the second body pose satisfies an acceptability threshold. In some implementations, the method includes in response to determining that the transition from the first body pose to the second body pose satisfies the acceptability threshold, generating a sequence of movements for a synthesized reality (SR) representation of the user.

公开(公告)号：US11238661B2

公开(公告)日：2022-02-01

申请号：US16965139

申请日：2019-02-15

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Michael J. Rockwell ,  Amritpal Singh Saini ,  Olivier Soares

IPC: G06T19/00 ,  G06N3/04 ,  G06N3/08

Abstract: In one implementation, a method includes: instantiating a first objective-effectuator (OE) associated with first attributes and a second OE associated with second attributes into a synthesized reality (SR) setting, wherein the first OE is encapsulated within the second OE; providing a first objective to the first OE based on the first and second attributes; providing a second objective to the second OE based on the second attributes, wherein the first and second objectives are associated with a time period between a first and second temporal points; generating a first set of actions for the first OE based on the first objective and a second set of actions for the second OE based on the second objective; and rendering for display the SR setting for the time period including the first set of actions performed by the first OE and the second set of actions performed by the second OE.

公开(公告)号：US20220012924A1

公开(公告)日：2022-01-13

申请号：US17484231

申请日：2021-09-24

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Andrew Scott Robertson

IPC: G06T11/00 ,  G06T13/80 ,  G06K9/00

Abstract: First content may be obtained in response to identifying a first physical element of a first object type. The first content may be associated with the first object type. Second content may be obtained in response to identifying a second physical element of a second object type. The second content may be associated with the second object type. The second physical element may be detected as being within a threshold distance of the first physical element. Third content may be generated based on a combination of the first content and the second content. The third content may be associated with a third object type that is different from the first object type and the second object type. The third content may be displayed on the display.

公开(公告)号：US11210520B2

公开(公告)日：2021-12-28

申请号：US16959253

申请日：2019-01-18

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Mohamed Selim Ben Himane ,  Peter Meier

IPC: G06K9/00 ,  G06T7/70 ,  G06T11/00

Abstract: In one implementation, a method includes: obtaining image data from an image sensor; recognizing a portion of an object within the image data; obtaining synthesized reality (SR) content—such as mixed reality, augmented reality, augmented virtuality, or virtual reality content—associated with the portion of the object; and displaying the SR content in association with the portion of the object. In some implementations, the SR content is dependent on the orientation of an electronic device or the user relative to the object. In some implementations, the SR content is generated based on sensor data associated with the object.

公开(公告)号：US20210272367A1

公开(公告)日：2021-09-02

申请号：US17057173

申请日：2019-05-28

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G06T19/00 ,  G06T15/20 ,  G06T15/00

Abstract: In some implementations, a method includes: presenting a synthesized reality (SR) setting associated with predetermined content from a first viewing vector at a first time; presenting a navigation timeline for the predetermined content including a plurality of viewing vector affordances at respective times on the navigation timeline, wherein each viewing vector characterizes how the SR content is displayed at the respective times; detecting an input selecting a respective viewing vector affordance on the navigation timeline associated with a second time within the predetermined content; and, in response to detecting the input selecting the respective viewing vector affordance on the navigation timeline, updating the SR setting in order to present the SR setting from a second viewing vector different from the first viewing vector, wherein the second viewing vector characterizes display of the predetermined content at the second times.

公开(公告)号：US11010982B1

公开(公告)日：2021-05-18

申请号：US16859850

申请日：2020-04-27

Applicant: Apple Inc.

Inventor： Gutemberg B. Guerra Filho ,  Ian M. Richter ,  Raffi A. Bedikian

IPC: G06T19/00 ,  G06T19/20 ,  G06K9/00

Abstract: In some implementations, a method includes: identifying, within first image data that corresponds to a first pose of a physical environment, a target physical object associated with a set of physical features that satisfies a mapping criterion for a computer-generated reality (CGR) object; assigning a secondary semantic label to the target physical object, wherein the secondary semantic label links the target physical object to the CGR object; and generating a CGR overlay associated with the CGR object based on one or more characteristics of the target physical object.

公开(公告)号：US10908796B1

公开(公告)日：2021-02-02

申请号：US16429808

申请日：2019-06-03

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G06F3/0484 ,  G06F3/0486 ,  G06F3/0482 ,  G06F3/16

Abstract: In some implementations, a method includes displaying a user interface that includes an objective-effectuator and a first affordance to manipulate the objective-effectuator. In some implementations, the objective-effectuator is characterized by a set of predefined objectives and a set of visual rendering attributes. In some implementations, the method includes instantiating the objective-effectuator in an emergent content container. In some implementations, the emergent content container allows the objective-effectuator to perform actions that satisfy the set of predefined objectives. In some implementations, the method includes displaying a second affordance in association with the emergent content container. In some implementations, the second affordance controls an operation of the emergent content container.

公开(公告)号：US20210027164A1

公开(公告)日：2021-01-28

申请号：US17070332

申请日：2020-10-14

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Amritpal Singh Saini ,  Olivier Soares

IPC: G06N3/08 ,  G06N3/04 ,  G06T19/00 ,  G06K9/62 ,  G06F16/951

Abstract: Various implementations disclosed herein include devices, systems, and methods for presenting objective-effectuators in synthesized reality settings. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes instantiating an objective-effectuator into a synthesized reality setting. In some implementations, the objective-effectuator is characterized by a set of predefined actions and a set of visual rendering attributes. In some implementations, the method includes obtaining an objective for the objective-effectuator. In some implementations, the method includes determining contextual information characterizing the synthesized reality setting. In some implementations, the method includes generating a sequence of actions from the set of predefined actions based on the contextual information and the objective. In some implementations, the method includes modifying the objective-effectuator based on the sequence of actions.

公开(公告)号：US12293025B2

公开(公告)日：2025-05-06

申请号：US18215318

申请日：2023-06-28

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Christopher Eubank ,  Tomlinson Holman

IPC: G06F3/01 ,  G06F3/04815 ,  G06T19/00 ,  G06F3/0482

Abstract: In various implementations, a method comprises: identifying a plurality of data items, each of the plurality of data items having at least a first metadata field or a second metadata field; displaying a volumetric environment including a first plurality of SR objects corresponding to a first plurality of data items among the plurality of data items, wherein the first plurality of data items includes the first metadata field with first metadata field values; detecting a first user input indicative of the second metadata field; and in response to detecting the first user input, replacing the first plurality of SR objects within the volumetric environment with a second plurality of SR objects corresponding to a second plurality of data items among the plurality of data items, wherein each of the second plurality of data items includes the second metadata field with second metadata field values.

公开(公告)号：US12272004B2

公开(公告)日：2025-04-08

申请号：US18383975

申请日：2023-10-26

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G06T19/00 ,  G06F3/01 ,  G06N3/04

Abstract: In some implementations, a method includes obtaining an end state of a first content item spanning a first time duration. In some implementations, the end state of the first content item indicates a first state of a synthesized reality (SR) agent at the end of the first time duration. In some implementations, the method includes obtaining an initial state of a second content item spanning a second time duration subsequent the first time duration. In some implementations, the initial state of the second content item indicates a second state of the SR agent at the beginning of the second time duration. In some implementations, the method includes synthesizing an intermediary emergent content item spanning over an intermediary time duration that is between the end of the first time duration and the beginning of the second time duration.