公开(公告)号：US12136264B2

公开(公告)日：2024-11-05

申请号：US17462867

申请日：2021-08-31

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G06V20/00 ,  G06F21/62 ,  G06T5/50 ,  G06T7/11 ,  G06T7/50 ,  G06V20/13 ,  G06V20/52

Abstract: Various implementations disclosed herein include devices, systems, and methods for obfuscating location data associated with a physical environment. In some implementations, a method includes obtaining, via an environmental sensor, environmental data corresponding to a physical environment. A first portion of the environmental data that corresponds to a first location is identified. In response to the first location being of a first location type, location data indicative of the first location is obfuscated from the environmental data by modifying the first portion of the environmental data.

公开(公告)号：US12033290B2

公开(公告)日：2024-07-09

申请号：US18233867

申请日：2023-08-14

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Michael J. Rockwell ,  Amritpal Singh Saini ,  Olivier Soares

IPC: G06T19/00 ,  G06N3/04 ,  G06N3/08

CPC classification number: G06T19/006 ,  G06N3/04 ,  G06N3/08

Abstract: In one implementation, a method includes: instantiating a first objective-effectuator (OE) associated with first attributes and a second OE associated with second attributes into a synthesized reality (SR) setting, wherein the first OE is encapsulated within the second OE; providing a first objective to the first OE based on the first and second attributes; providing a second objective to the second OE based on the second attributes, wherein the first and second objectives are associated with a time period between a first and second temporal points; generating a first set of actions for the first OE based on the first objective and a second set of actions for the second OE based on the second objective; and rendering for display the SR setting for the time period including the first set of actions performed by the first OE and the second set of actions performed by the second OE.

公开(公告)号：US20240046914A1

公开(公告)日：2024-02-08

申请号：US18237621

申请日：2023-08-24

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G10L13/00 ,  G06T11/00

CPC classification number: G10L13/00 ,  G06T11/00

Abstract: Various implementations disclosed herein include devices, systems, and methods for synthesizing virtual speech. In various implementations, a device includes a display, an audio sensor, a non-transitory memory and one or more processors coupled with the non-transitory memory. A computer-generated reality (CGR) representation of a fictional character is displayed in a CGR environment on the display. A speech input is received from a first person via the audio sensor. The speech input is modified based on one or more language characteristic values associated with the fictional character in order to generate CGR speech. The CGR speech is outputted in the CGR environment via the CGR representation of the fictional character.

公开(公告)号：US20240046507A1

公开(公告)日：2024-02-08

申请号：US18237616

申请日：2023-08-24

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G06T7/73 ,  G06T7/292 ,  G06T13/40 ,  G06N3/02 ,  H04L65/80 ,  G06V40/20 ,  G06V20/52 ,  G06V40/10 ,  G06V10/764 ,  G06V10/82 ,  G06V10/44 ,  G06V10/40

CPC classification number: G06T7/73 ,  G06T7/292 ,  G06T13/40 ,  G06N3/02 ,  H04L65/80 ,  G06V40/23 ,  G06V20/52 ,  G06V40/103 ,  G06V10/764 ,  G06V10/82 ,  G06V10/454 ,  G06V10/40 ,  G06T2207/30196 ,  G06T2207/10016

Abstract: Various implementations disclosed herein include devices, systems, and methods for low bandwidth transmission of event data. In various implementations, a device includes one or more cameras, a non-transitory memory, and one or more processors coupled with the one or more cameras and the non-transitory memory. In various implementations, the method includes obtaining, by the device, a set of images that correspond to a scene with a person. In various implementations, the method includes generating pose information for the person based on the set of images. In some implementations, the pose information indicates respective positions of body portions of the person. In some implementations, the method includes transmitting the pose information in accordance with a bandwidth utilization criterion.

公开(公告)号：US20230401758A1

公开(公告)日：2023-12-14

申请号：US18237656

申请日：2023-08-24

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Andrew Scott Robertson

IPC: G06T11/00 ,  G06V20/40 ,  G06T13/80

CPC classification number: G06T11/00 ,  G06V20/40 ,  G06T13/80 ,  G06T2200/24

Abstract: First content may be obtained in response to identifying a first physical element of a first object type. The first content may be associated with the first object type. Second content may be obtained in response to identifying a second physical element of a second object type. The second content may be associated with the second object type. The second physical element may be detected as being within a threshold distance of the first physical element. Third content may be generated based on a combination of the first content and the second content. The third content may be associated with a third object type that is different from the first object type and the second object type. The third content may be displayed on the display.

公开(公告)号：US11842729B1

公开(公告)日：2023-12-12

申请号：US16867947

申请日：2020-05-06

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G10L13/00 ,  G10L15/18 ,  G06F16/683 ,  G06N20/00 ,  G10L25/63 ,  G06F3/01 ,  G10L21/10

CPC classification number: G10L15/1815 ,  G06F3/011 ,  G06F16/685 ,  G06N20/00 ,  G10L21/10 ,  G10L25/63

Abstract: In one implementation, a method of generating CGR content to accompany an audio file including audio data and lyric data based on semantic analysis of the audio data and the lyric data is performed by a device including a processor, non-transitory memory, a speaker, and a display. The method includes obtaining an audio file including audio data and lyric data associated with the audio data. The method includes performing natural language analysis of at least a portion of the lyric data to determine a plurality of candidate meanings of the portion of the lyric data. The method includes performing semantic analysis of the portion of the lyric data to determine a meaning of the portion of the lyric data by selecting, based on a corresponding portion of the audio data, one of the plurality of candidate meanings as the meaning of the portion of the lyric data. The method includes generating CGR content associated with the portion of the lyric data based on the meaning of the portion of the lyric data.

公开(公告)号：US20230386149A1

公开(公告)日：2023-11-30

申请号：US18233867

申请日：2023-08-14

Applicant: Apple Inc.

Inventor： Ian M. Richter ,  Michael J. Rockwell ,  Amritpal Singh Saini ,  Olivier Soares

IPC: G06T19/00 ,  G06N3/04 ,  G06N3/08

CPC classification number: G06T19/006 ,  G06N3/08 ,  G06N3/04

Abstract: In one implementation, a method includes: instantiating a first objective-effectuator (OE) associated with first attributes and a second OE associated with second attributes into a synthesized reality (SR) setting, wherein the first OE is encapsulated within the second OE; providing a first objective to the first OE based on the first and second attributes; providing a second objective to the second OE based on the second attributes, wherein the first and second objectives are associated with a time period between a first and second temporal points; generating a first set of actions for the first OE based on the first objective and a second set of actions for the second OE based on the second objective; and rendering for display the SR setting for the time period including the first set of actions performed by the first OE and the second set of actions performed by the second OE.

公开(公告)号：US11783548B2

公开(公告)日：2023-10-10

申请号：US17053676

申请日：2019-05-29

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G06T7/60 ,  G06T19/00 ,  G06F3/16 ,  G06V20/10 ,  H04N21/43

CPC classification number: G06T19/006 ,  G06F3/165 ,  G06T7/60 ,  G06V20/10 ,  H04N21/43074

Abstract: In various implementations, methods of presenting an audio/SR experience are disclosed. In one embodiment, while playing an audio file in an environment, in response to determining that the respective temporal criterion and the respective environmental criterion of an SR content event is met, the SR content event is displayed in association with the environment. In one embodiment, SR content is obtained and displayed in association with an environment based on an audio file and a 3D point cloud of the environment. In one embodiment, SR content is obtained and displayed in association with an environment based on spoken words of a real sound of the environment.

公开(公告)号：US11733848B2

公开(公告)日：2023-08-22

申请号：US17707748

申请日：2022-03-29

Applicant: Apple Inc.

Inventor： Ian M. Richter

IPC: G06F3/04845 ,  G06F3/0486 ,  G06F3/0482 ,  G06F3/16

CPC classification number: G06F3/04845 ,  G06F3/0482 ,  G06F3/0486 ,  G06F3/167 ,  G06F2203/04803

Abstract: In some implementations, a method includes: displaying a user interface that includes a plurality of available objective-effectuators, wherein each of the plurality of available objective-effectuators is characterized by a set of predefined objectives; detecting a first user input that corresponds to instantiating a first objective-effectuator from among the available objective-effectuators in a first emergent content container; detecting a second user input that corresponds to instantiating a second objective-effectuator from among the available objective-effectuators in a second emergent content container separate from the first emergent content container; and in response to detecting the first and second user inputs, displaying, via the display, the first objective-effectuator in the first emergent content container including a first plurality of controls associated with the first emergent content container and the second objective-effectuator in the second emergent content container including a second plurality of controls associated with the second emergent content container.

公开(公告)号：US20220270335A1

公开(公告)日：2022-08-25

申请号：US17740052

申请日：2022-05-09

Applicant: Apple Inc.

Inventor： Bo Morgan ,  Mark E. Drummond ,  Peter Meier ,  Cameron J. Dunn ,  John Christopher Russell ,  Siva Chandra Mouli Sivapurapu ,  Ian M. Richter

IPC: G06T19/00 ,  A63F13/55 ,  G06F40/14 ,  G06F3/01

Abstract: In various implementations, a device surveys a scene and presents, within the scene, a extended reality (XR) environment including one or more assets that evolve over time (e.g., change location or age). Modeling such an XR environment at various timescales can be computationally intensive, particularly when modeling the XR environment over larger timescales. Accordingly, in various implementations, different models are used to determine the environment state of the XR environment when presenting the XR environment at different timescales.