-
公开(公告)号:US11095920B2
公开(公告)日:2021-08-17
申请号:US16769807
申请日:2018-11-29
发明人: Julien Fleureau , Bertrand Chupeau , Franck Thudor
IPC分类号: H04N19/597 , G06T9/00
摘要: A colored 3D scene is encoded as one or two patch atlas images. Points of the 3D scene belonging a part of the space defined according to a truncated sphere center on a point of view and visible from this point of view are iteratively projected onto projection maps. At each iteration the projected part is removed from the 3D scene and the truncated sphere defining the next part of the scene to be projected is rotated. Once the entirety of the 3D scene is projected on a set of projection maps, pictures are determined within these maps. A picture, also called patch, is a cluster of depth consistent connected pixels. Patches are packed in a depth and a color atlas associated with data comprising an information relative to the rotation of the truncated sphere, so, a decoder can retrieve the projection mapping and proceed to the inverse projection.
-
公开(公告)号:US12069301B2
公开(公告)日:2024-08-20
申请号:US17441051
申请日:2020-03-19
发明人: Julien Fleureau , Bertrand Chupeau , Gerard Briand , Renaud Dore , Franck Thudor
IPC分类号: G06T15/08 , G06T17/00 , H04N19/147 , H04N19/177 , H04N19/46 , H04N19/593 , H04N19/597 , G06T19/00
CPC分类号: H04N19/597 , G06T17/00 , H04N19/147 , H04N19/177 , H04N19/46 , H04N19/593 , G06T15/08 , G06T19/00 , G06T2200/04 , G06T2207/10028
摘要: A patch-based atlas format in intra-periods of varying length is used to encode a volumetric video. A first atlas layout is built for a first sequence of 3D scenes. The number of 3D scenes in the sequence is chosen to fit the size of a Group of Pictures of the codec. A second sequence is iteratively set up by appending the next 3D scene of the sequence to encode while the number of patches of the layout built for this iterative second sequence is lower than or equal to the number of patches of the first layout. When iterations end, one of the layouts is selected to generate every atlas of the group. In such a way, size of metadata is decreased, and compression is enhanced.
-
公开(公告)号:US12101506B2
公开(公告)日:2024-09-24
申请号:US17622278
申请日:2020-06-23
发明人: Julien Fleureau , Franck Thudor , Gerard Briand , Renaud Dore
IPC分类号: H04N19/597 , H04N19/70
CPC分类号: H04N19/597 , H04N19/70
摘要: At least one embodiment relates to a method and apparatus for encoding a volumetric video representing a scene, said encoding being based on patches representing the color and depth of a 2D projection of subparts of the scene, wherein a first patch is packed in a second patch for a given time interval lower than or equal to a time period along which the second patch is defined when said first patch can be packed in said second patch over said time interval. Decoding method and apparatus are also provided.
-
公开(公告)号:US20210400334A1
公开(公告)日:2021-12-23
申请号:US17297039
申请日:2019-11-22
发明人: Franck Thudor , Bertrand Chupeau , Renaud Dore
IPC分类号: H04N21/433 , H04N21/44
摘要: Methods and devices are provided to play back a video content item comprising loop sequences. The player manages two or three playing modes and switch between first-in first-out video buffer and circular video buffer with a size adapted to the loop sequences for which the player is in loop mode. A start point and an end point are obtained for each loop sequence of the video. In an embodiment, a code is associated with frames of the video to indicate to which loop(s) a frame belongs to.
-
公开(公告)号:US12101507B2
公开(公告)日:2024-09-24
申请号:US17786005
申请日:2020-12-17
发明人: Renaud Dore , Bertrand Chupeau , Franck Thudor , Julien Fleureau
IPC分类号: H04N19/597 , G06T9/00 , G06T15/08 , G06T15/20 , H04N21/235 , H04N21/2662 , H04N21/81
CPC分类号: H04N19/597 , G06T9/00 , G06T15/08 , G06T15/20 , H04N21/2353 , H04N21/2662 , H04N21/816
摘要: Methods and devices for encoding and decoding data representative of a 3D scene are disclosed. A set of first patches is generated from a first MVD content acquired from a first region of the 3D scene. A patch is a part of one of the views of the MVD content. A set of second patches is generated from a second MVD content acquired from a second region of the 3D scene. An atlas packing first and second patches is generated and associated with metadata indicating, for a patch of the atlas, whether the patch is a first or a second patch At the decoding side, first patches are used for rendering the viewport image and second patches are used for pre-processing or post-processing the viewport image.
-
6.
公开(公告)号:US12081719B2
公开(公告)日:2024-09-03
申请号:US17787364
申请日:2020-12-17
发明人: Julien Fleureau , Franck Thudor , Thierry Tapie , Renaud Dore
IPC分类号: H04N13/111 , H04N13/161 , H04N13/178
CPC分类号: H04N13/111 , H04N13/161 , H04N13/178
摘要: Methods and devices are provided for encoding, transmitting and decoding 3DoF+ volumetric video. At the encoding stage one input view (among all the input ones) is selected to convey the viewport dependent light effect and its id is transmitted to the decoder as an extra metadata. On the decoder side, when patches coming from this selected view are available for the rendering of the viewport, they are preferentially used regarding the other candidates whatever the view to synthesize position.
-
公开(公告)号:US20240249462A1
公开(公告)日:2024-07-25
申请号:US18285608
申请日:2022-04-04
发明人: Bertrand Chupeau , Renaud Dore , Julien Fleureau , Franck Thudor
IPC分类号: G06T15/06 , G06T7/50 , G06T7/90 , G06V10/56 , H04N13/351 , H04N19/597
CPC分类号: G06T15/06 , G06T7/50 , G06T7/90 , G06V10/56 , H04N13/351 , H04N19/597 , G06T2207/10024
摘要: Methods, devices and data streams are proposed to encode, transport and decode 3D volumetric videos. The embodiments encompass the signaling of non-Lambertian patches together with their light reflection properties, so as to enable a ray-tracing based rendering engine to synthesize visually realistic virtual views with respect to light effects. A retro-compatible solution enabling conventional rendering engines to render such described 3D scene but without the advanced light effects is also described.
-
8.
公开(公告)号:US20230362409A1
公开(公告)日:2023-11-09
申请号:US18029593
申请日:2021-09-29
发明人: Bertrand Chupeau , Franck Thudor , Renaud Dore
IPC分类号: H04N19/597 , G06V10/54 , G06V10/762 , H04N13/178 , H04N19/124 , H04N19/59
CPC分类号: H04N19/597 , G06V10/54 , G06V10/762 , H04N13/178 , H04N19/124 , H04N19/59
摘要: Methods, apparatus and data stream are described to encode, transmit and decode an atlas-based representation of a 3D scene based on a multiplane image (MPI) representation in which a depth component is encoded in each layer. Layers of the MPI are clustered on a transparency basis to generate texture, transparency and depth patch pictures. Patch pictures are packed in at least one atlas image. Metadata associating each patch to a layer and each layer to a depth and a depth quantization law are encoded in the data stream with the at least one atlas. At the decoding side, the MPI with a depth component is retrieved from the data stream and is used to render a viewport image from a viewpoint in the neighborhood of the center of the MPI.
-
公开(公告)号:US11758187B2
公开(公告)日:2023-09-12
申请号:US17464621
申请日:2021-09-01
发明人: Julien Fleureau , Thierry Tapie , Franck Thudor
IPC分类号: H04N19/85 , H04N19/136 , H04N19/172 , H04N19/177 , H04N19/182 , H04N19/186 , H04N19/597
CPC分类号: H04N19/597 , H04N19/136 , H04N19/172 , H04N19/177 , H04N19/182 , H04N19/186 , H04N19/85
摘要: A sequence of point clouds is encoded as a video by an encoder and transmitted to a decoder which retrieves the sequence of point clouds. Visible points of a point cloud are iteratively projected on projection maps according to at least two centers of projection, to determine a patch data item lists. One of the centers of projection is selected and corresponding image patches are generated and packed into a picture. Pictures and associated patch data item list are encoded in a stream. The decoding method decodes pictures and associated patch data item lists. Pixels of image patches comprised in pictures are un-projected according to data stored in associated patches. The methods have the advantage of encoding every point of point clouds in a manner avoiding artifacts and allowing decoding at video frame rate.
-
公开(公告)号:US20240193857A1
公开(公告)日:2024-06-13
申请号:US18285947
申请日:2022-04-12
发明人: Bertrand Chupeau , Renaud Dore , Gerard Briand , Julien Fleureau , Remy Gendrot , Franck Thudor , Neus Sabater , Thierry Tapie
IPC分类号: G06T17/00 , H04N13/279 , H04N19/597
CPC分类号: G06T17/00 , H04N13/279 , H04N19/597
摘要: Methods and devices for encoding and decoding 3D scenes of an immersive video are disclosed with the related data stream. Taking advantage of the fact that parts of the 3D scene does not change from one frame of the video to another, even when the cameras move and/or the lighting condition change, dynamic and static parts of the 3D scene are encoded in different atlases. In an embodiment, static patch atlases are repeated between two updates. In another embodiment, only updates are encoded and transmitted. The decoder maintains a memory associating entity of the 3D scene with a set of static patches that is updated with instructions linked to update static patch atlases. At each presentation time the static part of the 3D scene to decode is obtained from the memory.
-
-
-
-
-
-
-
-
-