Compression and Signaling of Displacements in Dynamic Mesh Compression

    公开(公告)号:US20250022182A1

    公开(公告)日:2025-01-16

    申请号:US18770285

    申请日:2024-07-11

    Applicant: Apple Inc.

    Abstract: A system comprises an encoder configured to compress and encode data for a three-dimensional dynamic mesh. The three-dimensional dynamic mesh is compressed and signaled using a base-mesh sub-bitstream and a displacement sub-bitstream. The displacement sub-bitstream comprises displacement information to be applied at sub-division points of the base mesh to recreate the three-dimensional dynamic mesh at a given moment in time. A separate data unit type is used to signal the displacement sub-bitstream that allows for efficient signaling of sub-blocks that are only partially occupied or empty. Also, a separate patch type may be used in an atlas bitstream to signal the displacement data units. A complimentary decoder decodes a compressed bitstream for the three-dimensional dynamic mesh, encoded such as by the encoder.

    Predictive coding for point cloud compression

    公开(公告)号:US12175716B2

    公开(公告)日:2024-12-24

    申请号:US18545925

    申请日:2023-12-19

    Applicant: Apple Inc.

    Abstract: A system receives encoded data regarding a points in a point cloud. The data includes a prediction tree having a nodes generated based on spatial information regarding the points and properties of a sensor system that obtained the spatial information. A value of each node represents first spatial coordinates of a respective one of the points according to a first coordinate system, and the value of at least a first node in the prediction tree is determined based on ancestor nodes of the first node and the properties of the sensor system. The system decodes the data to determine first data, including the first spatial coordinates of at least some of the points, and quantization parameters associated with the first spatial coordinates. The system determines second data based on the first data, including second spatial coordinates of at least some of the points according to a second coordinate system.

    Reference picture re-sampling
    55.
    发明授权

    公开(公告)号:US12058361B2

    公开(公告)日:2024-08-06

    申请号:US17723788

    申请日:2022-04-19

    Applicant: Apple Inc.

    CPC classification number: H04N19/503 H04N19/82 H04N19/86

    Abstract: Predictive coding techniques may include resampling of reference pictures, where various coding parameters are determined based on the resolution(s) or pixel format(s) of the prediction references. In a first aspect, lists of weights for use in weighted prediction are based on the resolution(s) of prediction references. In a second aspect, resampling filter parameters are selected based on the resolutions of prediction references. In a third aspect, deblocking filter parameters are based on the resolution(s) of prediction references.

    Mesh Compression Texture Coordinate Signaling and Decoding

    公开(公告)号:US20240153150A1

    公开(公告)日:2024-05-09

    申请号:US18494686

    申请日:2023-10-25

    Applicant: Apple Inc.

    CPC classification number: G06T9/001 H04N19/184

    Abstract: A system comprises an encoder configured to compress and encode data for three-dimensional visual volumetric content. To compress the 3D visual volumetric content, a compressed mesh is generated as well as compressed attribute information. Also, texture coordinates indicating a mapping between the vertices of the mesh and the attributes are signaled. However, in some situations a resolution used for the texture coordinates and a resolution used for the attributes may differ, in which case the respective resolutions are signaled. A decoder determines how to adjust the texture coordinate to attribute value mapping to account for the differing resolutions.

    Video-based point cloud compression with variable patch scaling

    公开(公告)号:US11889116B2

    公开(公告)日:2024-01-30

    申请号:US18046861

    申请日:2022-10-14

    Applicant: Apple Inc.

    CPC classification number: H04N19/597 H04N19/124 H04N19/30 H04N19/46

    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for volumetric visual content and/or a decoder configured to decompress compressed attribute and/or spatial information for the volumetric visual content. The encoder is configured to convert a 3D representation of the visual volumetric content into a 2D image based representation. The encoder is further configured to scale the patch in 2D space independent of any scaling in 3D space. Auxiliary information is signaled for use in identifying 2D scaled or unscaled patches in an image frame, mapping the patches into 3D space, and adjusting for any scaling factors applied at the encoder.

    Compression of attribute values comprising unit vectors

    公开(公告)号:US11854112B1

    公开(公告)日:2023-12-26

    申请号:US17663820

    申请日:2022-05-17

    Applicant: Apple Inc.

    CPC classification number: G06T15/04 G06T9/00 G06T11/40 G06T15/08 G06T17/20

    Abstract: A system compresses and decompresses attribute information for visual volumetric content, such as a mesh representation. Attribute values are included in the visual volumetric representation, wherein at least some of the attribute values include unitary vectors, such as surface normal vectors or surface tangent vectors having a magnitude of one unit. In order to compress the attribute information the three-dimensional unit vectors are mapped into two dimensional parametric coordinates for a planar representation of a unit sphere. To reduce negative effects on compression due to distortion or discontinuities in the planar representation, mappings for compressing respective unit vectors are adaptively selected.

Patent Agency Ranking