Unified coding of 3D objects and scenes

    公开(公告)号:US11196977B2

    公开(公告)日:2021-12-07

    申请号:US16798165

    申请日:2020-02-21

    Inventor: Danillo Graziosi

    Abstract: Methods for unified coding of 3D objects and 3D scenes are described herein. A flexible camera model is used to capture either parts of a 3D object or multiple views of a 3D scene. The flexible camera model is transmitted as metadata, and the captured 3D elements (objects and scenes) are combined in a 2D atlas image that is able to be further compressed with 2D video encoders. Described herein is a unification of two implementations for 3D coding: V-PCC and MIV. Projections of the scene/object of interest are used to map the 3D information into 2D, and then subsequently use video encoders. A general camera concept is able to represent both models via signaling to allow coding of both 3D objects and 3D scenes. With the flexible signaling of the camera model, the encoder is able to compress several different types of content into a single bitstream.

    PROJECTION-BASED MESH COMPRESSION
    12.
    发明申请

    公开(公告)号:US20210295566A1

    公开(公告)日:2021-09-23

    申请号:US17161300

    申请日:2021-01-28

    Abstract: A method of compressing untracked and tracked meshes using a projection-based approach, and leveraging the tools and syntax already generated for projection-based point cloud compression is described herein. Similar to the V-PCC approach, the mesh is segmented into surface patches, where a difference is that the segments follow the connectivity of the mesh. Each surface patch (or 3D patch) is then projected to a 2D patch, whereby in the case of the mesh, the triangle surface sampling is similar to a common rasterization approach used in computer graphics. For each patch, the position of the projected vertices is kept in a list, along with the connectivity of those vertices. The sampled surface resembles a point cloud and is coded with the same approach used for point cloud compression. Additionally, the list of vertices and connectivity is encoded per patch, and the data is sent along with the coded point cloud data.

    Point cloud mapping
    13.
    发明授权

    公开(公告)号:US11010955B2

    公开(公告)日:2021-05-18

    申请号:US16234164

    申请日:2018-12-27

    Inventor: Danillo Graziosi

    Abstract: Methods for mapping 3D point cloud data into 2D surfaces are described herein. The methods utilize 3D surface patches to represent point clouds and perform flexible mapping of 3D patch surface data into 2D canvas images. Patches representing geometry and patches representing attributes such as textures are placed in different canvases, where the placement of each patch is done independently for geometry and texture, that is, geometry and texture patches do not need to be co-located, as in conventional point cloud mapping. Furthermore, methods include transformations of the 3D patch when placing it into the 2D canvas, for more efficient packing.

    POINT CLOUD GEOMETRY PADDING
    14.
    发明申请

    公开(公告)号:US20200302578A1

    公开(公告)日:2020-09-24

    申请号:US16655685

    申请日:2019-10-17

    Inventor: Danillo Graziosi

    Abstract: A method of point cloud geometry padding is described herein. The method searches for a reconstruction point in a compressed occupancy map to perform the geometry padding instead of using an uncompressed occupancy map.

    POINT CLOUD CODING USING HOMOGRAPHY TRANSFORM

    公开(公告)号:US20200236401A1

    公开(公告)日:2020-07-23

    申请号:US16525175

    申请日:2019-07-29

    Inventor: Danillo Graziosi

    Abstract: A method of point cloud coding using homography transform sends the homography transform of the 3D patches, instead of the explicit projection values (such as bounding boxes and patch orientation, rotation). The method has a more compact notation, is more efficient in terms of transmission, and allows for a faster decoding, particularly in cases where the 3D points will be reprojected.

    Method and apparatus for point cloud color processing

    公开(公告)号:US10657689B2

    公开(公告)日:2020-05-19

    申请号:US16100033

    申请日:2018-08-09

    Abstract: A method for reducing color leaking artefacts in an image formed by projection processing from a 3D point cloud comprises: receiving an input image comprising the 3D point cloud; classifying the cloud into a plurality of surface patches; projecting the patches onto a plane to form a first 2D image; processing the first 2D image, by coding, transmitting and decoding, to form a final 2D image; and providing the final 2D image as an output. Processing comprises at least one of: coding comprising independent patch processing to reduce inter-patch color leakage; coding comprising background filling of pixels between patches to reduce inter-patch color leakage; coding comprising applying a chroma down-sampling scheme, based on depth and color value, that reduces intra-patch color leakage; and decoding comprising post-filtering to detect potential intra-patch color leakage, followed by an adaptive chroma up-sampling scheme that reduces intra-patch color leakage.

    POINT CLOUD MAPPING
    17.
    发明申请
    POINT CLOUD MAPPING 审中-公开

    公开(公告)号:US20200005518A1

    公开(公告)日:2020-01-02

    申请号:US16234164

    申请日:2018-12-27

    Inventor: Danillo Graziosi

    Abstract: Methods for mapping 3D point cloud data into 2D surfaces are described herein. The methods utilize 3D surface patches to represent point clouds and perform flexible mapping of 3D patch surface data into 2D canvas images. Patches representing geometry and patches representing attributes such as textures are placed in different canvases, where the placement of each patch is done independently for geometry and texture, that is, geometry and texture patches do not need to be co-located, as in conventional point cloud mapping. Furthermore, methods include transformations of the 3D patch when placing it into the 2D canvas, for more efficient packing.

    V3C SYNTAX NEW BASEMESH PATCH DATA UNIT

    公开(公告)号:US20240404200A1

    公开(公告)日:2024-12-05

    申请号:US18368511

    申请日:2023-09-14

    Abstract: A new high-level syntax element referred to as a basemesh patch data unit allows the transmission of syntax elements related to the basemesh component of a V3C bitstream. Previously, the V3C standard did not have any additional patches targeting the basemesh only. A basemesh patch data unit works with the previously disclosed sub-patch concept to provide syntax elements to be used with basemesh bitstream. The basemesh patch data unit allows mesh data and other types of data (e.g., point clouds) to be mixed together at the patch level and generate a richer representation of 3D objects. Furthermore, the basemesh patch data unit expands the concept of sub-meshes and patches by providing a flexible way to arrange the data in 3D (at the basemesh level) and in 2D (at the texture map level) allowing different configurations, instance, multiple attribute images and multiple basemeshes.

    ORTHOATLAS:  TEXTURE MAP GENERATION FOR DYNAMIC MESHES USING ORTHOGRAPHIC PROJECTIONS

    公开(公告)号:US20240127537A1

    公开(公告)日:2024-04-18

    申请号:US18114905

    申请日:2023-02-27

    Inventor: Danillo Graziosi

    CPC classification number: G06T17/20 G06T15/04

    Abstract: The generation of a texture map using orthographic projections is performed in a fast and efficient manner. A method to generate texture maps taking significantly less time and also allowing maps to exploit the correlation between content of different frames in time is described herein. The texture mapping is able to be used for automatic generation of volumetric content or for more efficient compression of dynamic meshes. The texture map generation described herein includes ways to generate a texture atlas using orthographic projections. A novel stretch metric for orthographic projections is described, and a merging algorithm is devised to optimally cluster triangles into a single patch. Additionally, packing techniques are able to be used for mesh patches that try to optimize size and temporal stability.

Patent Agency Ranking