公开(公告)号：US11064218B2

公开(公告)日：2021-07-13

申请号：US16823663

申请日：2020-03-19

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE ,  Poznan University of Technology

Inventor： Gwang Soon Lee ,  Jun Young Jeong ,  Hong Chang Shin ,  Kug Jin Yun ,  Marek Domanski ,  Olgierd Stankiewicz ,  Dawid Mieloch ,  Adrian Dziembowski ,  Adam Grzelka ,  Jakub Stankowski

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/167 ,  H04N13/161 ,  H04N13/178 ,  H04N13/00

Abstract: Disclosed herein is an image encoding/decoding method and apparatus for virtual view synthesis. The image decoding for virtual view synthesis may include decoding texture information and depth information of at least one or more basic view images and at least one or more additional view images from a bit stream and synthesizing a virtual view on the basis of the texture information and the depth information, wherein the basic view image and the additional view image comprise a non-empty region and an empty region, and wherein the synthesizing of the virtual view comprises determining the non-empty region through a specific value in the depth information and a threshold and synthesizing the virtual view by using the determined non-empty region.

公开(公告)号：US11483534B2

公开(公告)日：2022-10-25

申请号：US17006389

申请日：2020-08-28

Applicant: Electronics and Telecommunications Research Institute

Inventor： Kug Jin Yun ,  Jun Young Jeong ,  Gwang Soon Lee ,  Hong Chang Shin ,  Ho Min Eum

IPC: H04N13/161 ,  H04N13/178 ,  G06T15/20 ,  H04N13/282 ,  H04N13/00

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, a first flag indicating whether or not an atlas includes a patch including information on an entire region of a first source video may be encoded into the metadata.

公开(公告)号：US12212779B2

公开(公告)日：2025-01-28

申请号：US17339579

申请日：2021-06-04

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Jun Young Jeong ,  Kug Jin Yun ,  Gwang Soon Lee ,  Hong Chang Shin ,  Ho Min Eum

IPC: H04N19/597 ,  G06F18/25 ,  G06T7/40 ,  G06T7/50 ,  G06T9/00 ,  G06V20/40 ,  H04N13/161 ,  H04N19/46

Abstract: A method of processing an immersive video includes classifying view images into a basic image and an additional image, performing pruning with respect to view images by referring to a result of classification, generating atlases based on a result of pruning, generating a merged atlas by merging the atlases into one atlas, and generating configuration information of the merged atlas.

公开(公告)号：US11838485B2

公开(公告)日：2023-12-05

申请号：US17233151

申请日：2021-04-16

Applicant: Electronics and Telecommunications Research Institute

Inventor： Gwang Soon Lee ,  Jun Young Jeong ,  Kug Jin Yun ,  Hong Chang Shin ,  Ho Min Eum

IPC: H04N13/111 ,  H04N13/178 ,  H04N13/161

CPC classification number: H04N13/111 ,  H04N13/161 ,  H04N13/178

Abstract: A method of producing an immersive video comprises decoding an atlas, parsing a flag for the atlas, and producing a viewport image using the atlas. The flag may indicate whether the viewport image is capable of being completely produced through the atlas, and, according to a value of the flag, when the viewport image is produced, it may be determined whether an additional atlas is used in addition to the atlas.

公开(公告)号：US11212505B2

公开(公告)日：2021-12-28

申请号：US16777935

申请日：2020-01-31

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Gwang Soon Lee ,  Hong Chang Shin ,  Kug Jin Yun ,  Jun Young Jeong

IPC: H04N13/161 ,  H04N13/268 ,  H04N13/128 ,  H04N13/178

Abstract: Disclosed herein is an immersive video formatting method and apparatus for supporting motion parallax, The immersive video formatting method includes acquiring a basic video at a basic position, acquiring a multiple view video at at least one position different from the basic position, acquiring at least one residual video plus depth (RVD) video using the basic video and the multiple view video, and generating at least one of a packed video plus depth (PVD) video or predetermined metadata using the acquired basic video and the at least one RVD video.

公开(公告)号：US11044456B2

公开(公告)日：2021-06-22

申请号：US16428549

申请日：2019-05-31

Applicant: Electronics and Telecommunications Research Institute

Inventor： Jun Young Jeong ,  Kug Jin Yun

IPC: H04N13/183 ,  H04N13/178 ,  H04N13/282 ,  H04N13/161 ,  H04N13/271

Abstract: Disclosed are a method and a player for outputting an overlay that displays additional information on a 360-degree video. According to the present invention, an image processing method includes: decoding an overlay; and rendering the decoded overlay on a 360-degree video on the basis of overlay-related information. Here, the overlay-related information includes information indicating the number of the overlays and information indicating a unique identifier assigned to the overlay, and when multiple overlays are present, the identifiers assigned to the respective multiple overlays differ.

公开(公告)号：US11350074B2

公开(公告)日：2022-05-31

申请号：US16824951

申请日：2020-03-20

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Hong Chang Shin ,  Gwang Soon Lee ,  Sang Woon Kwak ,  Kug Jin Yun ,  Jun Young Jeong

IPC: H04N13/161 ,  H04N13/156 ,  H04N13/178

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method may include classifying a multiplicity of view videos into a base view and an additional view, generating a residual video for the additional view video classified as an additional view, packing a patch, which is generated based on the residual video, into an atlas video, and generating metadata for the patch.

公开(公告)号：US11140377B2

公开(公告)日：2021-10-05

申请号：US17029507

申请日：2020-09-23

Applicant: Electronics and Telecommunications Research Institute

Inventor： Gwang Soon Lee ,  Hong Chang Shin ,  Ho Min Eum ,  Jun Young Jeong

IPC: H04N13/161 ,  H04N13/178 ,  H04N13/282 ,  H04N13/00

Abstract: Disclosed herein is an immersive video processing method. The immersive video processing method includes: determining a priority order of pruning for source videos; extracting patches from the source videos based on the priority order of pruning; generating at least one atlas based on the extracted patches; and encoding metadata. Herein, the metadata may include first threshold information that becomes a criterion for distinguishing between a valid pixel and an invalid pixel in the atlas video.

公开(公告)号：US11037362B2

公开(公告)日：2021-06-15

申请号：US16913568

申请日：2020-06-26

Applicant: Electronics and Telecommunications Research Institute

Inventor： Hong-Chang Shin ,  Gwang Soon Lee ,  Jun Young Jeong

IPC: G06F3/01 ,  G06T15/10 ,  G06T3/00 ,  G06T7/194

Abstract: A method and an apparatus for generating a three-dimension (3D) virtual viewpoint image including: segmenting a first image into a plurality of images indicating different layers based on depth information of the first image at a gaze point of a user; and inpainting an area occluded by foreground in the plurality of images based on depth information of a reference viewpoint image are provided.

公开(公告)号：US11651472B2

公开(公告)日：2023-05-16

申请号：US17503940

申请日：2021-10-18

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE ,  Poznan University of Technology

Inventor： Gwang Soon Lee ,  Jun Young Jeong ,  Dawid Mieloch ,  Adrian Dziembowski ,  Marek Domanski

IPC: G06T3/00 ,  H04N19/46 ,  G06T9/00 ,  H04N19/44

CPC classification number: G06T3/0087 ,  G06T9/00 ,  H04N19/44 ,  H04N19/46

Abstract: A method for processing an immersive video includes: performing pruning for view images; generating an atlas by packing a patch that is extracted as a result of the pruning; deriving an offset for the patch that is comprised in the atlas; and correcting pixel values in the patch by using the derived offset.