公开(公告)号：US20230306687A1

公开(公告)日：2023-09-28

申请号：US17987847

申请日：2022-11-15

Applicant: SONY GROUP CORPORATION ,  Sony Corporation of America

Inventor： Danillo Graziosi ,  Alexandre Zaghetto ,  Ali Tabatabai

IPC: G06T17/20 ,  G06T9/00

CPC classification number: G06T17/205 ,  G06T9/00 ,  G06T2210/36 ,  G06T2210/56

Abstract: Ways to improve mesh reconstruction by modifying the position of vertices at the border of patches to make sure that neighboring patches do not have a gap between them, also known as zippering, are described herein. Six different methods to implement the post-processing operation, as well as syntax elements and semantics for transmission of the filter parameters, are disclosed. A hierarchical method indicate the geometry distortion that can generate gaps between patches. The value per frame, or per patch, or per boundary object is sent. The number of bits to encode the values is also dependent on the previous geometry distortion. A method sends index matches instead of geometry distortion. The matching index is sent per boundary vertex, but a method to send only one index of the pair is implemented as well.

公开(公告)号：US11375208B2

公开(公告)日：2022-06-28

申请号：US17030244

申请日：2020-09-23

Applicant: SONY CORPORATION

Inventor： Alexandre Zaghetto ,  Danillo Graziosi ,  Ali Tabatabai ,  Ohji Nakagami

IPC: H04N19/167 ,  H04N19/174 ,  G06T9/00 ,  H04N19/119 ,  H04N19/96

Abstract: Trisoup node size per slice enables flexibility when encoding a point cloud. Instead of each block/node being the same size, a user or machine is able to indicate block/node sizes such that regions of interest are able to have smaller node sizes for more specificity in that region.

公开(公告)号：US11334969B2

公开(公告)日：2022-05-17

申请号：US16655685

申请日：2019-10-17

Applicant: SONY CORPORATION

Inventor： Danillo Graziosi

IPC: G06T9/00 ,  G06T5/00

Abstract: A method of point cloud geometry padding is described herein. The method searches for a reconstruction point in a compressed occupancy map to perform the geometry padding instead of using an uncompressed occupancy map.

公开(公告)号：US20210174551A1

公开(公告)日：2021-06-10

申请号：US16859059

申请日：2020-04-27

Applicant: SONY CORPORATION

Inventor： Danillo Graziosi ,  Ohji Nakagami ,  Alexandre Zaghetto ,  Ali Tabatabai

IPC: G06T9/00 ,  G06T17/20

Abstract: A method of compressing meshes using a projection-based approach, and leveraging the tools and syntax already generated for projection-based point cloud compression is described herein. Similar to the V-PCC approach, the mesh is segmented into surface patches, only the difference is that the segments follow the connectivity of the mesh. Each surface patch (or 3D patch) is then projected to a 2D patch, whereby in the case of the mesh, the triangle surface sampling is similar to a common rasterization approach used in computer graphics. For each patch, the position of the projected vertices is kept in a list, along with the connectivity of those vertices. The sampled surface now resembles a point cloud, and is coded with the same approach used for point cloud compression. Additionally, the list of vertices and connectivity is encoded per patch, and this data is sent along with the coded point cloud data.

公开(公告)号：US20210104091A1

公开(公告)日：2021-04-08

申请号：US16778651

申请日：2020-01-31

Applicant: Sony Corporation

Inventor： Danillo Graziosi

IPC: G06T15/04 ,  G06T7/73 ,  G06T15/50

Abstract: A method for coding view-dependent texture attributes of points in a 3D point cloud prior to transmission and decoding includes creating a supplemental enhancement information (SIE) message for the 3D point cloud prior to transmission and decoding. The SEI message includes parameters related to texture attributes of individual points in the 3D point cloud for a plurality of viewing states at an initial time, such that when the SIE message is received at a decoder, the decoder is enabled to use the message to classify the texture attributes and apply one or more texture attributes to individual points such that the texture of each individual point in the decoded 3D point cloud is a correct representation of texture of that individual point in the 3D point cloud prior to transmission and decoding for each of the viewing states.

公开(公告)号：US10964089B1

公开(公告)日：2021-03-30

申请号：US16778651

申请日：2020-01-31

Applicant: Sony Corporation

Inventor： Danillo Graziosi

IPC: G06T15/00 ,  G06T15/04 ,  G06T15/50 ,  G06T7/70 ,  G06T7/73

Abstract: A method for coding view-dependent texture attributes of points in a 3D point cloud prior to transmission and decoding includes creating a supplemental enhancement information (SIE) message for the 3D point cloud prior to transmission and decoding. The SEI message includes parameters related to texture attributes of individual points in the 3D point cloud for a plurality of viewing states at an initial time, such that when the SIE message is received at a decoder, the decoder is enabled to use the message to classify the texture attributes and apply one or more texture attributes to individual points such that the texture of each individual point in the decoded 3D point cloud is a correct representation of texture of that individual point in the 3D point cloud prior to transmission and decoding for each of the viewing states.

公开(公告)号：US20210092345A1

公开(公告)日：2021-03-25

申请号：US16798165

申请日：2020-02-21

Applicant: SONY CORPORATION

Inventor： Danillo Graziosi

IPC: H04N13/161 ,  H04N19/136

Abstract: Methods for unified coding of 3D objects and 3D scenes are described herein. A flexible camera model is used to capture either parts of a 3D object or multiple views of a 3D scene. The flexible camera model is transmitted as metadata, and the captured 3D elements (objects and scenes) are combined in a 2D atlas image that is able to be further compressed with 2D video encoders. Described herein is a unification of two implementations for 3D coding: V-PCC and MIV. Projections of the scene/object of interest are used to map the 3D information into 2D, and then subsequently use video encoders. A general camera concept is able to represent both models via signaling to allow coding of both 3D objects and 3D scenes. With the flexible signaling of the camera model, the encoder is able to compress several different types of content into a single bitstream.

公开(公告)号：US20210006791A1

公开(公告)日：2021-01-07

申请号：US16812117

申请日：2020-03-06

Applicant: SONY CORPORATION

Inventor： Alexandre Zaghetto ,  Danillo Graziosi ,  Ali Tabatabai

IPC: H04N19/124 ,  H04N19/44 ,  G06T9/40

Abstract: A quantization scheme substitutes the division operation by forward and inverse quantization look-up tables to improve efficiency.

公开(公告)号：US20190318519A1

公开(公告)日：2019-10-17

申请号：US16100033

申请日：2018-08-09

Applicant: Sony Corporation

Inventor： Danillo Graziosi ,  Arash Vosoughi

IPC: G06T11/40 ,  G06T3/00 ,  H04N19/86 ,  H04N19/186

Abstract: A method for reducing color leaking artefacts in an image formed by projection processing from a 3D point cloud comprises: receiving an input image comprising the 3D point cloud; classifying the cloud into a plurality of surface patches; projecting the patches onto a plane to form a first 2D image; processing the first 2D image, by coding, transmitting and decoding, to form a final 2D image; and providing the final 2D image as an output. Processing comprises at least one of: coding comprising independent patch processing to reduce inter-patch color leakage; coding comprising background filling of pixels between patches to reduce inter-patch color leakage; coding comprising applying a chroma down-sampling scheme, based on depth and color value, that reduces intra-patch color leakage; and decoding comprising post-filtering to detect potential intra-patch color leakage, followed by an adaptive chroma up-sampling scheme that reduces intra-patch color leakage.

公开(公告)号：US10389994B2

公开(公告)日：2019-08-20

申请号：US15816094

申请日：2017-11-17

Applicant: SONY CORPORATION

Inventor： Danillo Graziosi

IPC: H04N13/117 ,  H04N19/20 ,  H04N19/597 ,  H04N19/85 ,  H04N13/282 ,  G06T15/04 ,  H04N13/161 ,  H04N13/243 ,  H04N13/178

Abstract: A decoder-centric codec for free-viewpoint video streaming enables a more efficient and more accurate process of capturing, preprocessing, encoding, decoding and rendering of multi-layer free-viewpoint video.