公开(公告)号：US08351685B2

公开(公告)日：2013-01-08

申请号：US12260986

申请日：2008-10-29

Applicant: Yo Sung Ho ,  Sang Beom Lee ,  Kwan Jung Oh

Inventor： Yo Sung Ho ,  Sang Beom Lee ,  Kwan Jung Oh

IPC: G06K9/00

CPC classification number: G06T7/55 ,  G06T15/205 ,  H04N19/597 ,  H04N19/61

Abstract: The present invention relates to a device and a method for estimating a depth map, and a method for making an intermediate image and a method for encoding multi-view video using the same. More particularly, the present invention relates to a device and a method for estimating a depth map that are capable of acquiring a depth map that reduces errors and complexity, and is resistant to external influence by dividing an area into segments on the basis of similarity, acquiring a segment-unit initial depth map by using a three-dimensional warping method and a self adaptation function to which an extended gradient map is reflected, and refining the initial depth map by performing a belief propagation method by the segment unit, and achieving smoother view conversion and improved encoding efficiency by generating an intermediate image with the depth map and utilizing the intermediate image for encoding a multi-view video, and a method for generating the intermediate image and a method for encoding the multi-view video using the same.

Abstract translation: 本发明涉及用于估计深度图的装置和方法，以及用于制作中间图像的方法和使用该深度图对多视图进行编码的方法。 更具体地，本发明涉及一种用于估计深度图的装置和方法，所述深度图能够获取降低误差和复杂度的深度图，并且通过基于相似度将区域划分为多个区域来抵抗外部影响， 通过使用反映扩展梯度图的三维变形方法和自适应功能来获取分段单元初始深度图，并且通过由分段单元执行置信传播方法来优化初始深度图，并且实现更平滑 通过使用深度图生成中间图像并利用中间图像对多视点视频进行编码来观看转换和改进的编码效率，以及用于生成中间图像的方法以及使用该多视点视频编码多视点视频的方法。

公开(公告)号：US20120162395A1

公开(公告)日：2012-06-28

申请号：US13247909

申请日：2011-09-28

Applicant: Yo-Sung HO ,  Cheon Lee

Inventor： Yo-Sung HO ,  Cheon Lee

IPC: H04N13/04 ,  H04N13/00

CPC classification number: G06T15/20 ,  G06T15/40 ,  H04N13/111 ,  H04N13/122

Abstract: Method for filling a hole-region and a three-dimensional (3D) video system using the same. In order to synthesize an image, a plurality of images each having a different viewpoint may be obtained. By using depth maps of the obtained plurality of images, an intermediate virtual viewpoint image may be synthesized. After synthesizing, a hole-region in the intermediate virtual viewpoint image may be filled using a color image of the intermediate virtual viewpoint image, a mask image indicating the hole-region in the intermediate virtual viewpoint image, and a depth image of the intermediate virtual viewpoint image.

Abstract translation: 用于填充孔区域的方法和使用其的三维（3D）视频系统。 为了合成图像，可以获得每个具有不同视点的多个图像。 通过使用所获得的多个图像的深度图，可以合成中间虚拟视点图像。 合成后，可以使用中间虚拟视点图像的彩色图像，指示中间虚拟视点图像中的空穴区域的掩模图像和中间虚拟视点图像的深度图像来填充中间虚拟视点图像中的空穴区域 视点形象。

公开(公告)号：US08165201B2

公开(公告)日：2012-04-24

申请号：US12013303

申请日：2008-01-11

Applicant: Yo Sung Ho ,  Cheon Lee ,  Kwan Jung Oh ,  Byeong Ho Choi

Inventor： Yo Sung Ho ,  Cheon Lee ,  Kwan Jung Oh ,  Byeong Ho Choi

IPC: H04N7/12

CPC classification number: H04N19/577 ,  H04N19/57 ,  H04N19/597

Abstract: The invention relates to a method of computing a disparity, a method of synthesizing an interpolation view, a method of encoding and decoding multi-view video using the same, and an encoder and a decoder using the same. In particular, the invention relates to a method of computing a disparity, a method of synthesizing an interpolation view, a method of encoding and decoding multi-view video using the same, and an encoder and a decoder using the same, which can rapidly compute an initial disparity of a block using region segmentation, accurately compute a disparity of the block using a variable block, and synthesize an interpolation view on the basis of a disparity value computed in a pixel basis using an adaptive search range, thereby improving quality of the interpolation view, and also can encode and decode a multi-view video independently from an existing prediction mode while using the interpolation view as a reference picture, thereby improving coding efficiency.

Abstract translation: 本发明涉及一种计算视差的方法，一种内插视图的合成方法，使用该方法的多视点视频的编码和解码方法，以及使用该方法的编码器和解码器。 特别地，本发明涉及一种计算视差的方法，一种内插视图的合成方法，使用该方法的多视点视频的编码和解码方法，以及使用该方法的编码器和解码器，其可快速计算 使用区域分割的块的初始视差，使用可变块精确地计算块的视差，并且基于使用自适应搜索范围在像素中计算的视差值来合成插值视图，从而提高 并且也可以在使用插值视图作为参考图像的情况下，独立于现有的预测模式对多视点视频进行编码和解码，从而提高编码效率。

公开(公告)号：US20100309292A1

公开(公告)日：2010-12-09

申请号：US12745099

申请日：2008-11-28

Applicant: Yo-Sung HO ,  Eun-Kyung Lee ,  Sung-Yeol Kim

Inventor： Yo-Sung HO ,  Eun-Kyung Lee ,  Sung-Yeol Kim

IPC: H04N13/02 ,  G06K9/00

CPC classification number: G06T7/55 ,  H04N13/261

Abstract: There are provided a method and an apparatus for generating a multi-viewpoint depth map, and a method for generating a disparity of a multi-viewpoint image. A method for generating a multi-viewpoint depth map according to the present invention includes the steps of: (a) acquiring a multi-viewpoint image constituted by a plurality of images by using a plurality of cameras (b) acquiring an image and depth information by using a depth camera; (c) estimating coordinates of the same point in a space in the plurality of images by using the acquired depth information; (d) determining disparities in the plurality of images with respect to in the same point by searching a predetermined region around the estimated coordinates; and (e) generating a multi-viewpoint depth map by using the determined disparities. According to the above-mentioned present invention, it is possible to generate a multi-viewpoint depth map within a shorter time and generate a multi-viewpoint depth map having higher quality than a multi-viewpoint depth map generated by using known stereo matching.

Abstract translation: 提供了一种用于生成多视点深度图的方法和装置，以及用于产生多视点图像的视差的方法。 根据本发明的用于生成多视点深度图的方法包括以下步骤：（a）通过使用多个照相机（b）获取由多个图像构成的多视点图像（b）获取图像和深度信息 通过使用深度相机; （c）通过使用获取的深度信息估计多个图像中的空间中的相同点的坐标; （d）通过搜索估计坐标周围的预定区域来确定在相同点上的多个图像中的差异; 和（e）通过使用确定的差异来生成多视点深度图。 根据上述本发明，可以在更短的时间内生成多视点深度图，并且生成比通过使用已知的立体匹配产生的多视点深度图具有更高质量的多视点深度图。

公开(公告)号：US20090129667A1

公开(公告)日：2009-05-21

申请号：US12260986

申请日：2008-10-29

Applicant: Yo Sung Ho ,  Sang Beom Lee ,  Kwang Jung Oh

Inventor： Yo Sung Ho ,  Sang Beom Lee ,  Kwang Jung Oh

IPC: G06K9/00

CPC classification number: G06T7/55 ,  G06T15/205 ,  H04N19/597 ,  H04N19/61

Abstract: The present invention relates to a device and a method for estimating a depth map, and a method for making an intermediate image and a method for encoding multi-view video using the same. More particularly, the present invention relates to a device and a method for estimating a depth map that are capable of acquiring a depth map that reduces errors and complexity, and is resistant to external influence by dividing an area into segments on the basis of similarity, acquiring a segment-unit initial depth map by using a three-dimensional warping method and a self adaptation function to which an extended gradient map is reflected, and refining the initial depth map by performing a belief propagation method by the segment unit, and achieving smoother view conversion and improved encoding efficiency by generating an intermediate image with the depth map and utilizing the intermediate image for encoding a multi-view video, and a method for generating the intermediate image and a method for encoding the multi-view video using the same.

Abstract translation: 本发明涉及用于估计深度图的装置和方法，以及用于制作中间图像的方法和使用该深度图对多视图进行编码的方法。 更具体地，本发明涉及一种用于估计深度图的装置和方法，所述深度图能够获取降低误差和复杂度的深度图，并且通过基于相似度将区域划分为多个区域来抵抗外部影响， 通过使用反映扩展梯度图的三维变形方法和自适应功能来获取分段单元初始深度图，并且通过由分段单元执行置信传播方法来优化初始深度图，并且实现更平滑 通过使用深度图生成中间图像并利用中间图像对多视点视频进行编码来观看转换和改进的编码效率，以及用于生成中间图像的方法以及使用该多视点视频编码多视点视频的方法。

公开(公告)号：US20080170753A1

公开(公告)日：2008-07-17

申请号：US11972794

申请日：2008-01-11

Applicant: Ji-Ho Park ,  Byeong-Ho Choi ,  Yong-Hwan Kim ,  Je-Woo Kim ,  Hwa-Seon Shin ,  Yo-Sung Ho

Inventor： Ji-Ho Park ,  Byeong-Ho Choi ,  Yong-Hwan Kim ,  Je-Woo Kim ,  Hwa-Seon Shin ,  Yo-Sung Ho

IPC: G06K9/00

CPC classification number: H04N13/161 ,  H04N19/105 ,  H04N19/176 ,  H04N19/50 ,  H04N19/597 ,  H04N19/61

Abstract: Provided are a method for image prediction of a multi-view video codec capable of improving coding efficiency, and a computer readable recording medium therefor. The method for image prediction of a multi-view video codec includes partitioning an image to a plurality of base blocks, acquiring information of reference images which are temporally different, acquiring information of reference images which have different views, and predicting a target block based on the acquired information. Accordingly, an image that is most similar to an image of a view to be currently compressed is generated using multiple images of different views, so that coding efficiency can be improved.

Abstract translation: 提供一种能够提高编码效率的多视点视频编解码器的图像预测方法及其计算机可读记录介质。 多视点视频编解码器的图像预测方法包括将图像划分为多个基块，获取暂时不同的参考图像的信息，获取具有不同视图的参考图像的信息，以及基于 获得的信息。 因此，使用不同视图的多个图像来生成与当前压缩视图的图像最相似的图像，从而可以提高编码效率。

公开(公告)号：US5282019A

公开(公告)日：1994-01-25

申请号：US875491

申请日：1992-04-29

Applicant: Carlo Basile ,  Aldo G. Cugnini ,  Alan P. Cavallerano ,  Yo-Sung Ho ,  David A. Bryan ,  Faramarz Azadegan ,  Mikhail Tsinberg

Inventor： Carlo Basile ,  Aldo G. Cugnini ,  Alan P. Cavallerano ,  Yo-Sung Ho ,  David A. Bryan ,  Faramarz Azadegan ,  Mikhail Tsinberg

IPC: H04L27/26 ,  H04N5/21 ,  H04N5/44 ,  H04N5/60 ,  H04N7/06 ,  H04N7/08 ,  H04N11/24 ,  H04N11/12

CPC classification number: H04N5/4401 ,  H04L27/2601 ,  H04L27/2608 ,  H04N11/002 ,  H04N5/211 ,  H04N5/44 ,  H04N7/063 ,  H04N7/08 ,  H04N5/602

Abstract: A method and apparatus for encoding a television source signal having a first bandwidth, into a frequency multiplexed signal having a narrower bandwidth and comprising a plurality of subcarriers modulated with digital information. Each of said subcarriers has an amplitude, bandwidth and coding characteristic which reflects the relative importance of the digital information provided thereby. The frequency multiplexed signal is suitable for use in a broadcasting environment wherein a conventional television signal is also used and wherein said subcarriers are disposed in frequency, in positions which are least likely to result in interference to or from said conventional signal. The invention also includes a receiver for decoding the frequency multiplexed signal and for providing a high definition display.

Abstract translation: 一种用于将具有第一带宽的电视信号源编码成具有较窄带宽并且包括用数字信息调制的多个子载波的频率复用信号的方法和装置。 所述子载波中的每一个具有反映由此提供的数字信息的相对重要性的幅度，带宽和编码特性。 频率复用信号适用于广播环境，其中也使用传统的电视信号，并且其中所述子载波被布置在频率上，在最不可能导致与所述常规信号的干扰的位置。 本发明还包括用于对频率复用信号进行解码并提供高清晰度显示的接收机。

公开(公告)号：US08804839B2

公开(公告)日：2014-08-12

申请号：US12146256

申请日：2008-06-25

Applicant: Ji Ho Park ,  Byeong Ho Choi ,  Je Woo Kim ,  Yong Hwan Kim ,  Hwa Seon Shin ,  Yo Sung Ho

Inventor： Ji Ho Park ,  Byeong Ho Choi ,  Je Woo Kim ,  Yong Hwan Kim ,  Hwa Seon Shin ,  Yo Sung Ho

IPC: H04N7/50

CPC classification number: H04N19/17 ,  H04N19/11 ,  H04N19/119 ,  H04N19/139 ,  H04N19/174 ,  H04N19/176 ,  H04N19/46 ,  H04N19/52 ,  H04N19/593 ,  H04N19/597 ,  H04N19/61

Abstract: In a method for image prediction of a multi-view video codec, a disparity vector value of a current macroblock is obtained and a corresponding macroblock is searched through the obtained disparity vector value. An intra prediction coding direction value of the searched macroblock is determined as an intra prediction coding direction value of the current macroblock. The current macroblock is coded/decoded through the determined intra prediction coding direction value. The coding efficiency can be increased by reducing a coding amount by omitting a process of obtaining an unnecessary disparity value by using a different-view intra prediction coding direction as a current-view intra prediction coding direction. The coding efficiency can be increased by reducing a coding amount by differentially coding a similar disparity vector. The reliability can be increased through an accurate disparity using multiples of 8 rather than 16, in motion skip for sharing the format of a macroblock.

Abstract translation: 在多视点视频编解码器的图像预测方法中，获得当前宏块的视差矢量值，并通过获得的视差矢量值搜索对应的宏块。 所检索的宏块的帧内预测编码方向值被确定为当前宏块的帧内预测编码方向值。 通过确定的帧内预测编码方向值对当前宏块进行编码/解码。 通过省略通过使用不同视角的帧内预测编码方向获得不必要的视差值的处理作为当前视图帧内预测编码方向，可以通过减少编码量来增加编码效率。 可以通过对类似的视差矢量进行差分编码来减少编码量来增加编码效率。 可以通过使用8而不是16的倍数的精确视差来增加可靠性，在运动跳跃中用于共享宏块的格式。

公开(公告)号：US08179969B2

公开(公告)日：2012-05-15

申请号：US12377985

申请日：2007-08-17

Applicant: Yo Sung Ho ,  Kwan Jung Oh

Inventor： Yo Sung Ho ,  Kwan Jung Oh

IPC: H04N7/12 ,  G06K9/36

CPC classification number: H04N19/105 ,  H04N13/194 ,  H04N19/597

Abstract: The present invention relates to a method and apparatus for encoding a multi-view video and a method and apparatus for decoding a multi-view video, and more particularly, to a method and apparatus for encoding a multi-view video and a method and apparatus for decoding a multi-view video that can perform encoding and decoding in consideration of global disparity between pictures captured at two different viewpoints to remove spatial redundancy. An embodiment of the invention provides an encoder for compressing data for pictures captured at different viewpoints using global disparity in a multi-view video. The encoder includes: an input unit that receives pictures captured at two or more viewpoints; a reference picture generating unit that generates a new reference picture on the basis of the global disparity between a target picture and a reference picture; and a motion predicting unit that calculates motion vectors of the target picture on the basis of the reference picture.

Abstract translation: 本发明涉及用于对多视点视频进行编码的方法和装置以及用于对多视点视频进行解码的方法和装置，更具体地说，涉及用于对多视点视频进行编码的方法和装置以及方法和装置 用于解码可以考虑在两个不同视点捕获的图像之间的全局差异来执行编码和解码的多视图视频，以消除空间冗余。 本发明的实施例提供一种编码器，用于使用多视点视频中的全局视差来压缩在不同视点处拍摄的图像的数据。 编码器包括：接收在两个或多个视点捕获的图像的输入单元; 参考图像生成单元，其基于目标图像和参考图像之间的全局视差来生成新的参照图像; 以及运动预测单元，其基于所述参考图片计算所述目标图像的运动矢量。

公开(公告)号：US20100166074A1

公开(公告)日：2010-07-01

申请号：US12377985

申请日：2007-08-17

Applicant: Yo Sung Ho ,  Kwan Jung Oh

Inventor： Yo Sung Ho ,  Kwan Jung Oh

IPC: H04N7/12

CPC classification number: H04N19/105 ,  H04N13/194 ,  H04N19/597

Abstract: The present invention relates to a method and apparatus for encoding a multi-view video and a method and apparatus for decoding a multi-view video, and more particularly, to a method and apparatus for encoding a multi-view video and a method and apparatus for decoding a multi-view video that can perform encoding and decoding in consideration of global disparity between pictures captured at two different viewpoints to remove spatial redundancy. An embodiment of the invention provides an encoder for compressing data for pictures captured at different viewpoints using global disparity in a multi-view video. The encoder includes: an input unit that receives pictures captured at two or more viewpoints; a reference picture generating unit that generates a new reference picture on the basis of the global disparity between a target picture and a reference picture; and a motion predicting unit that calculates motion vectors of the target picture on the basis of the reference picture.

Abstract translation: 本发明涉及用于对多视点视频进行编码的方法和装置以及用于对多视点视频进行解码的方法和装置，更具体地说，涉及用于对多视点视频进行编码的方法和装置以及方法和装置 用于解码可以考虑在两个不同视点捕获的图像之间的全局差异来执行编码和解码的多视图视频，以消除空间冗余。 本发明的实施例提供一种编码器，用于使用多视点视频中的全局视差来压缩在不同视点处拍摄的图像的数据。 编码器包括：接收在两个或多个视点捕获的图像的输入单元; 参考图像生成单元，其基于目标图像和参考图像之间的全局视差来生成新的参照图像; 以及运动预测单元，其基于所述参考图片计算所述目标图像的运动矢量。