-
公开(公告)号:US11196977B2
公开(公告)日:2021-12-07
申请号:US16798165
申请日:2020-02-21
Applicant: SONY CORPORATION
Inventor: Danillo Graziosi
IPC: H04N13/161 , H04N19/136
Abstract: Methods for unified coding of 3D objects and 3D scenes are described herein. A flexible camera model is used to capture either parts of a 3D object or multiple views of a 3D scene. The flexible camera model is transmitted as metadata, and the captured 3D elements (objects and scenes) are combined in a 2D atlas image that is able to be further compressed with 2D video encoders. Described herein is a unification of two implementations for 3D coding: V-PCC and MIV. Projections of the scene/object of interest are used to map the 3D information into 2D, and then subsequently use video encoders. A general camera concept is able to represent both models via signaling to allow coding of both 3D objects and 3D scenes. With the flexible signaling of the camera model, the encoder is able to compress several different types of content into a single bitstream.
-
公开(公告)号:US20210295566A1
公开(公告)日:2021-09-23
申请号:US17161300
申请日:2021-01-28
Applicant: SONY CORPORATION
Inventor: Danillo Graziosi , Ohji Nakagami , Alexandre Zaghetto , Ali Tabatabai
Abstract: A method of compressing untracked and tracked meshes using a projection-based approach, and leveraging the tools and syntax already generated for projection-based point cloud compression is described herein. Similar to the V-PCC approach, the mesh is segmented into surface patches, where a difference is that the segments follow the connectivity of the mesh. Each surface patch (or 3D patch) is then projected to a 2D patch, whereby in the case of the mesh, the triangle surface sampling is similar to a common rasterization approach used in computer graphics. For each patch, the position of the projected vertices is kept in a list, along with the connectivity of those vertices. The sampled surface resembles a point cloud and is coded with the same approach used for point cloud compression. Additionally, the list of vertices and connectivity is encoded per patch, and the data is sent along with the coded point cloud data.
-
公开(公告)号:US11010955B2
公开(公告)日:2021-05-18
申请号:US16234164
申请日:2018-12-27
Applicant: SONY CORPORATION
Inventor: Danillo Graziosi
IPC: G06T15/04
Abstract: Methods for mapping 3D point cloud data into 2D surfaces are described herein. The methods utilize 3D surface patches to represent point clouds and perform flexible mapping of 3D patch surface data into 2D canvas images. Patches representing geometry and patches representing attributes such as textures are placed in different canvases, where the placement of each patch is done independently for geometry and texture, that is, geometry and texture patches do not need to be co-located, as in conventional point cloud mapping. Furthermore, methods include transformations of the 3D patch when placing it into the 2D canvas, for more efficient packing.
-
公开(公告)号:US20200302578A1
公开(公告)日:2020-09-24
申请号:US16655685
申请日:2019-10-17
Applicant: SONY CORPORATION
Inventor: Danillo Graziosi
Abstract: A method of point cloud geometry padding is described herein. The method searches for a reconstruction point in a compressed occupancy map to perform the geometry padding instead of using an uncompressed occupancy map.
-
公开(公告)号:US20200236401A1
公开(公告)日:2020-07-23
申请号:US16525175
申请日:2019-07-29
Applicant: SONY CORPORATION
Inventor: Danillo Graziosi
Abstract: A method of point cloud coding using homography transform sends the homography transform of the 3D patches, instead of the explicit projection values (such as bounding boxes and patch orientation, rotation). The method has a more compact notation, is more efficient in terms of transmission, and allows for a faster decoding, particularly in cases where the 3D points will be reprojected.
-
公开(公告)号:US10657689B2
公开(公告)日:2020-05-19
申请号:US16100033
申请日:2018-08-09
Applicant: Sony Corporation
Inventor: Danillo Graziosi , Arash Vosoughi
IPC: G06T11/40 , G06T3/00 , H04N19/186 , H04N19/86
Abstract: A method for reducing color leaking artefacts in an image formed by projection processing from a 3D point cloud comprises: receiving an input image comprising the 3D point cloud; classifying the cloud into a plurality of surface patches; projecting the patches onto a plane to form a first 2D image; processing the first 2D image, by coding, transmitting and decoding, to form a final 2D image; and providing the final 2D image as an output. Processing comprises at least one of: coding comprising independent patch processing to reduce inter-patch color leakage; coding comprising background filling of pixels between patches to reduce inter-patch color leakage; coding comprising applying a chroma down-sampling scheme, based on depth and color value, that reduces intra-patch color leakage; and decoding comprising post-filtering to detect potential intra-patch color leakage, followed by an adaptive chroma up-sampling scheme that reduces intra-patch color leakage.
-
公开(公告)号:US20200005518A1
公开(公告)日:2020-01-02
申请号:US16234164
申请日:2018-12-27
Applicant: SONY CORPORATION
Inventor: Danillo Graziosi
IPC: G06T15/04
Abstract: Methods for mapping 3D point cloud data into 2D surfaces are described herein. The methods utilize 3D surface patches to represent point clouds and perform flexible mapping of 3D patch surface data into 2D canvas images. Patches representing geometry and patches representing attributes such as textures are placed in different canvases, where the placement of each patch is done independently for geometry and texture, that is, geometry and texture patches do not need to be co-located, as in conventional point cloud mapping. Furthermore, methods include transformations of the 3D patch when placing it into the 2D canvas, for more efficient packing.
-
公开(公告)号:US20240404200A1
公开(公告)日:2024-12-05
申请号:US18368511
申请日:2023-09-14
Applicant: SONY GROUP CORPORATION , Sony Corporation of America
Inventor: Danillo Graziosi , Ali Tabatabai
Abstract: A new high-level syntax element referred to as a basemesh patch data unit allows the transmission of syntax elements related to the basemesh component of a V3C bitstream. Previously, the V3C standard did not have any additional patches targeting the basemesh only. A basemesh patch data unit works with the previously disclosed sub-patch concept to provide syntax elements to be used with basemesh bitstream. The basemesh patch data unit allows mesh data and other types of data (e.g., point clouds) to be mixed together at the patch level and generate a richer representation of 3D objects. Furthermore, the basemesh patch data unit expands the concept of sub-meshes and patches by providing a flexible way to arrange the data in 3D (at the basemesh level) and in 2D (at the texture map level) allowing different configurations, instance, multiple attribute images and multiple basemeshes.
-
公开(公告)号:US20240233189A1
公开(公告)日:2024-07-11
申请号:US18115386
申请日:2023-02-28
Applicant: SONY GROUP CORPORATION , Sony Corporation of America
Inventor: Danillo Graziosi , Ali Tabatabai
Abstract: With the concept of sub-patches, the single geometry is described at the patch level, while the multiple attributes are then described at the sub-patch level. One application of the concept is the derivation of texture coordinates using projections for several sections of a mesh surface (affecting the attributes only), whereby the geometry of the whole mesh section uses just one single syntax element.
-
公开(公告)号:US20240127537A1
公开(公告)日:2024-04-18
申请号:US18114905
申请日:2023-02-27
Applicant: SONY GROUP CORPORATION , Sony Corporation of America
Inventor: Danillo Graziosi
Abstract: The generation of a texture map using orthographic projections is performed in a fast and efficient manner. A method to generate texture maps taking significantly less time and also allowing maps to exploit the correlation between content of different frames in time is described herein. The texture mapping is able to be used for automatic generation of volumetric content or for more efficient compression of dynamic meshes. The texture map generation described herein includes ways to generate a texture atlas using orthographic projections. A novel stretch metric for orthographic projections is described, and a merging algorithm is devised to optimally cluster triangles into a single patch. Additionally, packing techniques are able to be used for mesh patches that try to optimize size and temporal stability.
-
-
-
-
-
-
-
-
-