-
公开(公告)号:US11341725B2
公开(公告)日:2022-05-24
申请号:US17267985
申请日:2019-09-25
Applicant: Apple Inc.
Inventor: Ian M. Richter
Abstract: In some implementations, a method includes obtaining an end state of a first content item spanning a first time duration. In some implementations, the end state of the first content item indicates a first state of a synthesized reality (SR) agent at the end of the first time duration. In some implementations, the method includes obtaining an initial state of a second content item spanning a second time duration subsequent the first time duration. In some implementations, the initial state of the second content item indicates a second state of the SR agent at the beginning of the second time duration. In some implementations, the method includes synthesizing an intermediary emergent content item spanning over an intermediary time duration that is between the end of the first time duration and the beginning of the second time duration.
-
公开(公告)号:US11320977B2
公开(公告)日:2022-05-03
申请号:US17129327
申请日:2020-12-21
Applicant: Apple Inc.
Inventor: Ian M. Richter
IPC: G06F3/04845 , G06F3/0486 , G06F3/0482 , G06F3/16
Abstract: In some implementations, a method includes displaying a user interface that includes an objective-effectuator and a first affordance to manipulate the objective-effectuator. In some implementations, the objective-effectuator is characterized by a set of predefined objectives and a set of visual rendering attributes. In some implementations, the method includes instantiating the objective-effectuator in an emergent content container. In some implementations, the emergent content container allows the objective-effectuator to perform actions that satisfy the set of predefined objectives. In some implementations, the method includes displaying a second affordance in association with the emergent content container. In some implementations, the second affordance controls an operation of the emergent content container.
-
公开(公告)号:US20220012283A1
公开(公告)日:2022-01-13
申请号:US17482402
申请日:2021-09-22
Applicant: Apple Inc.
Inventor: Ian M. Richter
IPC: G06F16/783 , G06F16/78 , G06T7/11 , G06F16/75
Abstract: A method includes obtaining a first unstructured video stream that provides pixel values for a plurality of pixels and corresponds to a portion of a second unstructured video stream being displayed on a second electronic device different from the first electronic device. Obtaining the first unstructured video stream includes obtaining pass-through image data including the portion of a second unstructured video stream. The method includes generating respective pixel characterization vectors for a first portion of the plurality of pixels. Generating each of the respective pixel characterization vectors includes determining a respective instance label value. The method includes identifying a first object within the first portion of the plurality of pixels associated with a particular instance label value. The method includes generating respective semantic label values corresponding to pixels associated with the first object. The respective semantic label values are added to pixel characterization vectors associated with the first object.
-
公开(公告)号:US20210366179A1
公开(公告)日:2021-11-25
申请号:US17397437
申请日:2021-08-09
Applicant: Apple Inc.
Inventor: Ian M. Richter , Maxime Meilland , Patrick W. O'Keefe
Abstract: In one implementation, a method includes: obtaining locality data characterizing objects and relative spatial information of a volumetric region around a user; synthesizing a mesh map of the volumetric region based on the locality data; selecting synthesized reality (SR) content based on the mesh map, wherein the SR content satisfies a dimensional variance threshold relative to one or more portions of the mesh map; compositing at least a portion of the SR content with the mesh map in order to generate composite SR content; and presenting the composite SR content to the user in order to occlude at least a portion of a visual presentation of the volumetric region. In some implementations, the SR content is adapted to fit the one or more portions of the mesh map. In some implementations, the SR content is updated as the user location changes or the user interacts with the SR content.
-
公开(公告)号:US10810415B1
公开(公告)日:2020-10-20
申请号:US16140330
申请日:2018-09-24
Applicant: Apple Inc.
Inventor: Ian M. Richter
Abstract: Various implementations disclosed herein include devices, systems, and methods for low bandwidth transmission of event data. In various implementations, a device includes one or more cameras, a non-transitory memory, and one or more processors coupled with the one or more cameras and the non-transitory memory. In various implementations, the method includes obtaining, by the device, a set of images that correspond to a scene with a person. In various implementations, the method includes generating pose information for the person based on the set of images. In some implementations, the pose information indicates respective positions of body portions of the person. In some implementations, the method includes transmitting the pose information in accordance with a bandwidth utilization criterion.
-
公开(公告)号:US12293759B2
公开(公告)日:2025-05-06
申请号:US18385540
申请日:2023-10-31
Applicant: Apple Inc.
Inventor: Ian M. Richter
Abstract: In one implementation, a method of generating CGR content to accompany an audio file including audio data and lyric data based on semantic analysis of the audio data and the lyric data is performed by a device including a processor, non-transitory memory, a speaker, and a display. The method includes obtaining an audio file including audio data and lyric data associated with the audio data. The method includes performing natural language analysis of at least a portion of the lyric data to determine a plurality of candidate meanings of the portion of the lyric data. The method includes performing semantic analysis of the portion of the lyric data to determine a meaning of the portion of the lyric data by selecting, based on a corresponding portion of the audio data, one of the plurality of candidate meanings as the meaning of the portion of the lyric data. The method includes generating CGR content associated with the portion of the lyric data based on the meaning of the portion of the lyric data.
-
公开(公告)号:US12272008B2
公开(公告)日:2025-04-08
申请号:US17865910
申请日:2022-07-15
Applicant: Apple Inc.
Inventor: Ian M. Richter , Qi Shan
IPC: G06T19/00
Abstract: Various implementations disclosed herein include devices, systems, and methods for synthesizing an environment based on an image. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In various implementations, a method includes determining an engagement score that characterizes a level of engagement between a user and a representation of a subject included in an image. In some implementations, the method includes, in response to the engagement score satisfying an engagement threshold, obtaining stored information regarding the subject, and synthesizing an environment based on the image and the stored information regarding the subject.
-
公开(公告)号:US20250069340A1
公开(公告)日:2025-02-27
申请号:US18812432
申请日:2024-08-22
Applicant: Apple Inc.
Inventor: Gutemberg B. Guerra Filho , Raffi A. Bedikian , Ian M. Richter
Abstract: In some implementations, a method includes: identifying a plurality of subsets associated with a physical environment; determining a set of spatial characteristics for each of the plurality of subsets, wherein a first set of spatial characteristics characterizes dimensions of a first subset and a second set of spatial characteristics characterizes dimensions of a second subset; generating an adapted first extended reality (XR) content portion for the first subset based at least in part on the first set of spatial characteristics; generating an adapted second XR content portion for the second subset based at least in part on the second set of spatial characteristics; and generating one or more navigation options that allow a user to traverse between the first and second subsets based on the first and second sets of spatial characteristics.
-
公开(公告)号:US20240428444A1
公开(公告)日:2024-12-26
申请号:US18800229
申请日:2024-08-12
Applicant: Apple Inc.
Inventor: Ian M. Richter
IPC: G06T7/73 , G06N3/02 , G06T7/292 , G06T13/40 , G06V10/40 , G06V10/44 , G06V10/764 , G06V10/82 , G06V20/52 , G06V40/10 , G06V40/20 , H04L65/80
Abstract: Various implementations disclosed herein include devices, systems, and methods for low bandwidth transmission of event data. In various implementations, a device includes one or more cameras, a non-transitory memory, and one or more processors coupled with the one or more cameras and the non-transitory memory. In various implementations, the method includes obtaining, by the device, a set of images that correspond to a scene with a person. In various implementations, the method includes generating pose information for the person based on the set of images. In some implementations, the pose information indicates respective positions of body portions of the person. In some implementations, the method includes transmitting the pose information in accordance with a bandwidth utilization criterion.
-
公开(公告)号:US12175796B2
公开(公告)日:2024-12-24
申请号:US17496517
申请日:2021-10-07
Applicant: Apple Inc.
Inventor: Ian M. Richter
Abstract: A method includes displaying, via a display, an environment that includes a representation of a person associated with the device. The representation includes a virtual face with virtual facial features corresponding to respective physical facial features of the person associated with the device. The method includes detecting, via a sensor, a change in a physical facial feature of the person associated with the device. The physical facial feature indicates a physical facial expression of the person. In response to determining that the physical facial expression breaches a criterion, modifying one or more virtual facial features of the virtual face so that the virtual face indicates a virtual facial expression that satisfies the criterion.
-
-
-
-
-
-
-
-
-