-
11.
公开(公告)号:US12219118B1
公开(公告)日:2025-02-04
申请号:US17678815
申请日:2022-02-23
Applicant: Apple Inc.
Inventor: Afshin Taghavi Nasrabadi , Maneli Noorkami
Abstract: In one implementation, a camera rig comprises: a first array of image sensors arranged in a planar configuration, wherein the first array of image sensors is provided to capture a first image stream from a first perspective of a physical environment; a second array of image sensors arranged in a non-planar configuration, wherein the second array of image sensors is provided to capture a second image stream from a second perspective of the physical environment different from the first perspective; a buffer provided to store the first and second image streams; and an image processing engine provided to generate a 3D reconstruction of the physical environment based on the first and second image streams.
-
公开(公告)号:US11825103B2
公开(公告)日:2023-11-21
申请号:US17825167
申请日:2022-05-26
Applicant: Apple Inc.
Inventor: Maneli Noorkami , Ranjit Desai
Abstract: Systems and methods for gaze-driven recording of video are described. Some implementations may include accessing gaze data captured using one or more gaze-tracking sensors; applying a temporal filter to the gaze data to obtain a smoothed gaze estimate; determining a region of interest based on the smoothed gaze estimate, wherein the region of interest identifies a subset of a field of view; accessing a frame of video; recording a portion of the frame associated with the region of interest as an enhanced frame of video, wherein the portion of the frame corresponds to a smaller field of view than the frame; and storing, transmitting, or displaying the enhanced frame of video.
-
公开(公告)号:US11418769B1
公开(公告)日:2022-08-16
申请号:US17222872
申请日:2021-04-05
Applicant: Apple Inc.
Inventor: Afshin Taghavi Nasrabadi , Maneli Noorkami , Ranjit Desai
IPC: H04N13/117 , G06T15/08 , H04N13/161 , H04N13/178
Abstract: A system comprises an encoder configured to compress and encode data for three-dimensional volumetric content. The encoder also is configured to segment the three-dimensional volumetric content based on viewing areas, wherein different ones of the viewing areas correspond to visible portions of the volumetric content. The system may provide metadata to a client device to support viewport adaptive rendering of the three-dimensional volumetric content or may adaptively stream portions of the three-dimensional volumetric content to a rending device based on viewing areas of the three-dimensional volumetric content that are to be rendered at the rendering device.
-
公开(公告)号:US12185096B2
公开(公告)日:2024-12-31
申请号:US17016110
申请日:2020-09-09
Applicant: Apple Inc.
Inventor: Ranjit Desai , Maneli Noorkami , Joel N. Kerr
IPC: G06F21/00 , G06F21/14 , G06F21/62 , G06T5/20 , G06T5/70 , G06V20/00 , G06V20/20 , G06V40/10 , G06V40/16 , H04W12/02 , G06F21/10 , G06Q20/14
Abstract: Implementations of the subject technology provides analyzing a recording of content within a field of view of a device, the analyzing including recognition of a set of objects included in the content. The subject technology identifies a subset of the set of objects that are indicated as corresponding to protected content. The subject technology generates a modified version of the recording that obfuscates or filters the subset of the set of objects. Additionally, the subject technology provides the modified version of the recording to a host application for playback.
-
公开(公告)号:US20240406364A1
公开(公告)日:2024-12-05
申请号:US18644222
申请日:2024-04-24
Applicant: Apple Inc.
Inventor: Maneli Noorkami , Afshin Taghavi Nasrabadi , Alexander P. Yu , Michael A. Glass , Travis W. Brown
IPC: H04N13/189 , H04N13/156 , H04N13/178 , H04N13/366
Abstract: A head-mounted device is provided that includes a variety of subsystems for generating extended reality content, displaying the extended reality content, and recording the extended reality content. The device may include a graphics rendering pipeline configured to render virtual content, tracking sensors configured to obtain user tracking information, a virtual content compositor configured to composite virtual frames based on the virtual content and the user tracking information, cameras configured to capture a video feed, a media merging compositor configured to overlay the composited virtual frames and the video feed, and a recording pipeline configured to record parameters, metadata, raw content, and/or adjusted content in an extended reality recording file. The extended reality recording file may have multiple discrete portions that may each be individually edited. The extended reality recording file may be used to present a replay on the head-mounted device and/or may be exported to an external device.
-
公开(公告)号:US11948338B1
公开(公告)日:2024-04-02
申请号:US17691754
申请日:2022-03-10
Applicant: Apple Inc.
Inventor: Khaled Mammou , Fabrice A. Robinet , Maneli Noorkami , Afshin Taghavi Nasrabadi
IPC: G06T9/00 , G06T3/40 , G06T3/4023 , G06T15/10 , G06T17/20
CPC classification number: G06T9/001 , G06T3/4023 , G06T15/10 , G06T17/205 , G06T2200/04 , G06T2200/08 , G06T2210/08
Abstract: An encoder encodes three-dimensional (3D) volumetric content, such as immersive media, using video encoded attribute patch images packed into a 2D atlas to communicate the attribute values for the 3D volumetric content. The encoder also uses mesh-encoded sub-meshes to communicate geometry information for portions of the 3D object or scene corresponding to the attribute patch images packed into the 2D atlas. The encoder applies decimation operations to the sub-meshes to simplify the sub-meshes before mesh encoding the sub-meshes. A distortion analysis is performed to bound the level to which the sub-meshes are simplified at the encoder. Mesh simplification at the encoder reduces the number of vertices and edges included in the sub-meshes which simplifies rendering at a decoder receiving the encoded 3D volumetric content.
-
公开(公告)号:US11861788B1
公开(公告)日:2024-01-02
申请号:US17347404
申请日:2021-06-14
Applicant: Apple Inc.
Inventor: Afshin Taghavi Nasrabadi , Maneli Noorkami
CPC classification number: G06T15/08 , G06T7/50 , G06T9/00 , G06T2207/10016
Abstract: One or more computing devices implement a mesh analysis for evaluating meshes to be rendered when rendering immersive content. The mesh analysis identifies objects in a three-dimensional scene and determines geometrical complexity values for the objects. Objects with similar geometrical complexities are grouped into areas and a mesh vertices budget is determined for the respective areas. Metadata indicating the area definitions and corresponding mesh vertices budgets are generated. The metadata may be uploaded to a server to simplify meshes in the scene prior to streaming to a client, or the metadata may be provided to a client for use in simplifying the meshes as part of rendering the scene.
-
公开(公告)号:US20230362226A1
公开(公告)日:2023-11-09
申请号:US18335669
申请日:2023-06-15
Applicant: Apple Inc.
Inventor: Maneli Noorkami , Ranjit Desai , Joel N. Kerr , Perry A. Caro
CPC classification number: H04L65/70 , G06F3/012 , G02B27/017 , H04L65/80 , H04L65/762
Abstract: Techniques are disclosed relating to encoding recorded content for distribution to other computing devices. In some embodiments, a first computing device creates recorded content for transmission to a second computing device configured to present the recorded content. To encode the recorded content, the first computing device detects, via a network interface of the first computing device, one or more computing nodes available to encode the recorded content in one or more formats supported by the second computing device. The first computing device offloads the recorded content via the network interface to the one or more computing nodes for encoding in the one or more formats. In some embodiments, the second computing device receives a request from a user to stream content recorded by a first computing device and requests the content in a first format being encoded by a computing node assisting the first computing device.
-
公开(公告)号:US11533351B2
公开(公告)日:2022-12-20
申请号:US17320199
申请日:2021-05-13
Applicant: Apple Inc.
Inventor: Maneli Noorkami , Ranjit Desai
Abstract: Techniques are disclosed relating to encoding recorded content for distribution to other computing devices. In various embodiments, a first computing device records content of a physical environment in which the first computing device is located, the content being deliverable to a second computing device configured to present a corresponding environment based on the recorded content and content recorded by one or more additional computing devices. The first computing device determines a location of the first computing device within the physical environment and encodes the location in a manifest usable to stream the content recorded by the first computing device to the second computing device. The encoded location is usable by the second computing device to determine whether to stream the content recorded by the first computing device.
-
公开(公告)号:US11521359B2
公开(公告)日:2022-12-06
申请号:US17184585
申请日:2021-02-24
Applicant: Apple Inc.
Inventor: Maneli Noorkami , Ranjit Desai , Perry A. Caro , Joel N. Kerr
Abstract: Implementations of the subject technology provide systems and methods for recording an extended reality experience in a way that allows the experience to be played back at a later time from a different viewpoint or perspective. This allows computer-generated content that was rendered for display to a user during the recording, to be re-rendered during playback at the correct time and location in the recording, but from a different perspective. In order to facilitate this type of viewer-centric playback, the recording includes a computer-generated content track that references resources for re-rendering the computer-generated content at each point in time in the recording.
-
-
-
-
-
-
-
-
-