公开(公告)号：US08451894B2

公开(公告)日：2013-05-28

申请号：US12086709

申请日：2007-01-04

申请人： Masayuki Tanimoto ,  Toshiaki Fujii ,  Kenji Yamamoto ,  Masaki Kitahara ,  Hideaki Kimata ,  Shinya Shimizu ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Masayuki Tanimoto ,  Toshiaki Fujii ,  Kenji Yamamoto ,  Masaki Kitahara ,  Hideaki Kimata ,  Shinya Shimizu ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： H04N7/12 ,  H04N7/50

CPC分类号： H04N19/64 ,  H04N19/105 ,  H04N19/147 ,  H04N19/176 ,  H04N19/597 ,  H04N19/61

摘要： By using parallax compensation which performs prediction by using parallax between video images, the video images are encoded as a single video image. Reference parallax for a target image to be encoded is set, wherein the reference parallax is estimated using a reference image; area division in an image frame is set; parallax displacement for each divided area is set, wherein the parallax displacement is the difference between the reference parallax and parallax for the parallax compensation; data of the area division is encoded; and data for indicating the parallax displacement is encoded. During decoding, reference parallax for a target image to be decoded is set, wherein it is estimated using a reference image; data for indicating area division, which is included in encoded data, is decoded; and data of parallax displacement, which is included in the encoded data, is decoded for each area indicated by the area division data.

摘要翻译： 通过使用通过使用视频图像之间的视差执行预测的视差补偿，将视频图像编码为单个视频图像。 设置要编码的目标图像的参考视差，其中使用参考图像来估计参考视差; 设置图像帧中的区域划分; 设定每个分割区域的视差位移，其中视差位移是视差补偿的参考视差和视差之差; 区域划分的数据被编码; 并且用于指示视差位移的数据被编码。 在解码期间，设置要解码的目标图像的参考视差，其中使用参考图像来估计; 包含在编码数据中的用于指示区域划分的数据被解码; 并且包括在编码数据中的视差位移的数据对于由区域划分数据指示的每个区域被解码。

公开(公告)号：US08204118B2

公开(公告)日：2012-06-19

申请号：US12665890

申请日：2008-06-23

申请人： Shinya Shimizu ,  Hideaki Kimata ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Shinya Shimizu ,  Hideaki Kimata ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： H04N7/12

CPC分类号： H04N19/597 ,  H04N19/105 ,  H04N19/12 ,  H04N19/134 ,  H04N19/172 ,  H04N19/176

摘要： A video encoding apparatus used in encoding of a multi-viewpoint image. The apparatus generates a synthetic image for a camera used for obtaining an encoding target image, by using an already-encoded reference camera image having a viewpoint different from the viewpoint of the camera used for obtaining the encoding target image, and disparity information between the reference camera image and the encoding target image, thereby encoding the encoding target image. A predicted image for a differential image between an input image of an encoding target area to be encoded and the synthetic image generated therefor is generated, and a predicted image for the encoding target area, which is represented by the sum of the predicted differential image and the synthetic image for the encoding target area, is generated. A prediction residual represented by a difference between the predicted image for the encoding target area and the encoding target image of the encoding target area is encoded.

摘要翻译： 一种用于多视点图像编码的视频编码装置。 该装置通过使用具有与用于获得编码对象图像的摄像机的视点不同的视点的已经编码的参照摄像机图像，生成用于获取编码对象图像的摄像机的合成图像，以及参考 摄像机图像和编码对象图像，由此对编码对象图像进行编码。 生成要编码的编码对象区域的输入图像与生成的编码对象区域的合成图像之间的差分图像的预测图像，并且生成用于编码对象区域的预测图像，该预测图像由预测差分图像和 生成编码对象区域的合成图像。 对编码对象区域的预测图像与编码对象区域的编码对象图像之间的差异表示的预测残差进行编码。

公开(公告)号：US20100208991A1

公开(公告)日：2010-08-19

申请号：US12682030

申请日：2008-10-09

申请人： Hideaki Kimata ,  Shinya Shimizu ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Hideaki Kimata ,  Shinya Shimizu ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： G06K9/00

CPC分类号： G06T5/50 ,  G06T15/205 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20221 ,  H04N1/6055

摘要： An image generation method for generating image information of a color signal Y of an image A by using a color signal X of image A, and color signal X and color signal Y of an image B. The presence or absence of a point in color signal X of image B corresponding to each pixel position of color signal X of image A, and the position of the relevant corresponding point are estimated. To each estimated pixel position in color signal Y of image A, image information of the corresponding position in the second color signal Y of image B is assigned. Color signal Y at a pixel position in image A for which it is estimated that there is no corresponding point is generated by using the image information of color signal Y assigned to pixels having a corresponding point.

摘要翻译： 用于通过使用图像A的颜色信号X以及图像B的颜色信号X和颜色信号Y来生成图像A的颜色信号Y的图像信息的图像生成方法。存在或不存在颜色信号点 对应于图像A的颜色信号X的每个像素位置的图像B的X和相关对应点的位置被估计。 对于图像A的颜色信号Y中的每个估计像素位置，分配图像B的第二颜色信号Y中的对应位置的图像信息。 通过使用分配给具有对应点的像素的颜色信号Y的图像信息来生成估计没有对应点的图像A中的像素位置处的颜色信号Y。

公开(公告)号：US20100086222A1

公开(公告)日：2010-04-08

申请号：US12441234

申请日：2007-09-18

申请人： Shinya Shimizu ,  Masaki Kitahara ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Shinya Shimizu ,  Masaki Kitahara ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： G06K9/36

CPC分类号： H04N19/103 ,  H04N19/147 ,  H04N19/176 ,  H04N19/52 ,  H04N19/597 ,  H04N19/61

摘要： An image encoding method includes determining and encoding global parallax data which is probably correct parallax data in consideration of the Epipolar geometry constraint between a camera of a standard viewpoint, which is selected from the entire multi-viewpoint images, and images obtained by all the other viewpoints; generating base parallax data for each camera as a viewpoint other than the standard viewpoint, where the base parallax data is probably correct parallax data in consideration of the Epipolar geometry constraint between the image of the relevant camera and the images of all the other cameras based on the global parallax data and the camera parameters; determining and encoding correction parallax data used for correcting the base parallax data, so as to indicate parallax data between the image of the relevant camera and an already-encoded reference viewpoint image used for parallax compensation; and encoding the image of the relevant camera by using parallax data obtained by correcting the base parallax data by means of the correction parallax data.

摘要翻译： 图像编码方法包括：考虑到从整个多视点图像中选择的标准视点的相机之间的双极几何约束，以及所有其他图像获得的图像，确定和编码可能是正确的视差数据的全局视差数据 观点; 生成基准视差数据作为除了标准视点以外的视点的基准视差数据，其中考虑到相机的图像和所有其它相机的图像之间的对极几何约束，基准视差数据可能是正确的视差信息，基于 全局视差数据和摄像机参数; 确定和编码用于校正基准视差数据的校正视差数据，以便指示相关摄像机的图像与用于视差补偿的已经编码的参考视点图像之间的视差信息; 并且通过使用通过校正视差数据校正基准视差数据而获得的视差信息来对相关相机的图像进行编码。

公开(公告)号：US20070098068A1

公开(公告)日：2007-05-03

申请号：US10559903

申请日：2004-07-22

申请人： Hideaki Kimata ,  Masaki Kitahara ,  Kazuto Kamikura

发明人： Hideaki Kimata ,  Masaki Kitahara ,  Kazuto Kamikura

IPC分类号： H04N7/12

CPC分类号： H04N19/136 ,  H04N19/105 ,  H04N19/172 ,  H04N19/176 ,  H04N19/423 ,  H04N19/46 ,  H04N19/503

摘要： In order to make it possible to obtain the correct decoded image even in the case of not decoding a particular frame of the encoded data and improve the coding efficiency, the predicted image production unit 103 selects the image data from the image data of a plurality of frames in the reference image memory 107 which are encoded in the past, of the i-th (1≦i≦j) category, for the current frame which is classified as the j-th category by the image classifying unit 102, and produces the predicted image. The difference encoding unit 104 encodes a difference between the image data of the current frame and the predicted image. Also, the current category encoding unit 106 encodes the category number of the current frame, and the reference image specifying data encoding unit 105 encodes the reference image specifying data which specifies the image data selected from the reference image memory 107.

摘要翻译： 为了即使在不对编码数据的特定帧进行解码并提高编码效率的情况下也可以获得正确的解码图像，预测图像生成单元103从多个图像数据的图像数据中选择图像数据 对于由图像分类单元102分类为第j个类别的当前帧，过去编码的参考图像存储器107中的第i（1 <= i <= j）个类别的帧， 并产生预测图像。 差编码单元104对当前帧的图像数据和预测图像之间的差进行编码。 此外，当前类别编码单元106对当前帧的类别编号进行编码，并且参考图像指定数据编码单元105对指定从参考图像存储器107中选择的图像数据的参考图像指定数据进行编码。

公开(公告)号：US09066096B2

公开(公告)日：2015-06-23

申请号：US12517457

申请日：2007-12-26

申请人： Shinya Shimizu ,  Masaki Kitahara ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Shinya Shimizu ,  Masaki Kitahara ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： H04N19/103 ,  H04N19/597 ,  H04N19/176 ,  H04N19/147 ,  H04N19/61 ,  H04N19/146 ,  H04N19/182 ,  H04N19/19 ,  H04N19/573

CPC分类号： H04N19/103 ,  H04N19/146 ,  H04N19/147 ,  H04N19/176 ,  H04N19/182 ,  H04N19/19 ,  H04N19/573 ,  H04N19/597 ,  H04N19/61

摘要： A video encoding method for generating, based on disparity information between an already-encoded reference camera image and an encoding target camera image corresponding to the reference camera image, a disparity-compensated image by means of inter-camera image prediction; and encoding a differential image between the encoding target camera image and the disparity-compensated image. The method includes selecting, for each predetermined section unit on the differential image, one of a decoded differential image group obtained by decoding a differential image between the already-encoded camera image and the disparity-compensated image and a decoded camera image group obtained by decoding the already-encoded camera image, by determining whether or not there is a disparity-compensated image at the corresponding position, that is, whether or not the corresponding pixel in the disparity-compensated image has an effective value.

摘要翻译： 一种视频编码方法，用于基于已经编码的参考相机图像和与参考相机图像相对应的编码对象相机图像之间的视差信息，通过相机间图像预测生成视差补偿图像; 并且对编码对象摄像机图像和视差补偿图像之间的差分图像进行编码。 该方法包括对差分图像上的每个预定部分单元选择通过解码已经编码的照相机图像和视差补偿图像之间的差分图像获得的解码差分图像组和通过解码获得的解码相机图像组之一 已经编码的摄像机图像，通过确定在相应位置是否存在视差补偿图像，即，视差补偿图像中的相应像素是否具有有效值。

公开(公告)号：US09008173B2

公开(公告)日：2015-04-14

申请号：US12682035

申请日：2008-10-14

申请人： Shohei Matsuo ,  Seishi Takamura ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Shohei Matsuo ,  Seishi Takamura ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N19/19 ,  H04N19/147 ,  H04N19/46 ,  H04N19/61 ,  H04N19/593 ,  H04N19/11 ,  H04N19/136 ,  H04N19/182

CPC分类号： H04N19/19 ,  H04N19/11 ,  H04N19/136 ,  H04N19/147 ,  H04N19/182 ,  H04N19/46 ,  H04N19/593 ,  H04N19/61

摘要： A method for encoding an image using an intraframe prediction is provided which includes selecting a gradient of a pixel value that is indicated by an image signal to be predicted among a plurality of gradient candidates, generating a predicted signal by applying a gradient in accordance with the distance from a prediction reference pixel based on the gradient, intraframe-encoding the image signal to be predicted based on the predicted signal, and encoding information indicating the size of the selected gradient. Alternatively, the method includes estimating the gradient of a pixel value that is indicated by an image signal to be predicted based on an image signal which has already been encoded, generating a predicted signal by applying a gradient in accordance with the distance from a prediction reference pixel based on the gradient, and intraframe-encoding the image signal to be predicted based on the predicted signal.

摘要翻译： 提供了一种使用帧内预测对图像进行编码的方法，包括：通过在多个梯度候选中选择由要预测的图像信号指示的像素值的梯度，通过应用根据 基于该梯度的与预测参考像素的距离，基于预测信号对要预测的图像信号进行帧内编码，以及编码指示所选择的梯度的大小的信息。 或者，该方法包括基于已经被编码的图像信号估计由要预测的图像信号指示的像素值的梯度，通过根据与预测参考的距离应用梯度来生成预测信号 基于所述梯度的像素，并且基于所述预测信号对要预测的图像信号进行帧内编码。

公开(公告)号：US08509302B2

公开(公告)日：2013-08-13

申请号：US13123690

申请日：2009-10-21

申请人： Kazuya Hayase ,  Yukihiro Bandoh ,  Seishi Takamura ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Kazuya Hayase ,  Yukihiro Bandoh ,  Seishi Takamura ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： H04N7/12

CPC分类号： H04N19/103 ,  H04N19/105 ,  H04N19/187 ,  H04N19/196 ,  H04N19/197 ,  H04N19/51 ,  H04N19/577 ,  H04N19/593

摘要： In scalable video encoding, incidence rates of combinations of optimum prediction modes to be selected for spatially corresponding blocks of an upper layer and a lower layer are determined based on an optimum prediction mode that was selected in a conventional encoding, and then a correspondence table that describes relationships therebetween is created. Subsequently, the combinations of the selected optimum prediction modes described in the correspondence table are narrowed down based on the value of the incidence rate so as to create prediction mode correspondence information that describes the combinations of the optimum prediction mode narrowed down. When encoding the upper layer block, the prediction mode search candidate that is to be searched in the encoding is decided by referring to the prediction mode correspondence information using as a key the optimum prediction mode selected in the encoding of the spatially corresponding lower layer block and thereby reducing the number of the prediction mode search candidates.

摘要翻译： 在可分级视频编码中，基于在常规编码中选择的最佳预测模式来确定要选择用于上层和下层的空间对应块的最佳预测模式的组合的发生率，然后是对应表， 描述之间的关系被创建。 随后，基于入射率的值，将对应表中描述的所选择的最佳预测模式的组合变窄，以便产生描述缩小的最佳预测模式的组合的预测模式对应信息。 当对上层块进行编码时，通过参照在空间对应的下层块的编码中选择的最佳预测模式作为关键字的预测模式对应信息来决定在编码中要搜索的预测模式搜索候选，以及 从而减少预测模式搜索候选的数量。

公开(公告)号：US08355596B2

公开(公告)日：2013-01-15

申请号：US12682027

申请日：2008-10-09

申请人： Hideaki Kimata ,  Shinya Shimizu ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Hideaki Kimata ,  Shinya Shimizu ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： G06K9/40

CPC分类号： G06T5/50 ,  G06T2200/32 ,  G06T2207/10016 ,  G06T2207/20208 ,  G06T2207/20221

摘要： An image generation method for generating image information of an image C by using an image A and an image B having a bit depth higher than that of image A. Image C having the same bit depth as image B is generated by increasing the bit depth of image A by means of tone mapping; presence or absence of a point in image B corresponding to each pixel position of image C and the position of the relevant corresponding point are estimated; and to each pixel position in image C for which it is estimated that there is a corresponding point, image information of the corresponding position in image B is assigned. It is possible to generate image information at each pixel position in image C for which it is estimated in the corresponding point estimation that there is no corresponding point, by using the image information assigned according to an estimation result that there is a corresponding point.

摘要翻译： 用于通过使用图像A和比特深度高于图像A的图像A的图像B来生成图像C的图像信息的图像生成方法。通过增加图像B的位深度来生成具有与图像B相同的位深度的图像C. 图像A通过色调映射; 估计对应于图像C的每个像素位置的图像B中的点的存在或不存在以及相关对应点的位置; 并且对于估计有相应点的图像C中的每个像素位置，分配图像B中相应位置的图像信息。 通过使用根据具有对应点的估计结果分配的图像信息，可以在图像C中的每个像素位置生成图像信息，该图像信息在相应的点估计中被估计为没有对应点。

公开(公告)号：US20110188574A1

公开(公告)日：2011-08-04

申请号：US13122054

申请日：2009-10-21

申请人： Shohei Matsuo ,  Seishi Takamura ,  Kazuto Kamikura ,  Yoshiyuki Yashima

发明人： Shohei Matsuo ,  Seishi Takamura ,  Kazuto Kamikura ,  Yoshiyuki Yashima

IPC分类号： H04N7/32

CPC分类号： H04N19/117 ,  H04N19/14 ,  H04N19/157 ,  H04N19/176 ,  H04N19/182 ,  H04N19/82 ,  H04N19/86

摘要： A direction is detected for each block in which a pixel value is changed which is represented by an edge that indicates a direction of change in pixel value in each block, a direction in which a deblocking filter is to be applied to a block boundary is determined based on a direction of an edge detected for a block to be processed which includes the block boundary subject to deblocking and on a direction of an edge detected for a block contacting the block to be processed, and the deblocking filter is applied to the block boundary in accordance with the determined direction.

摘要翻译： 对于由表示每个块中的像素值的变化方向的边缘表示像素值被改变的每个块，将去块滤波器应用于块边界的方向确定的每个块的方向被确定 基于检测到的块的边缘的方向，其包括被解块的块边界，以及针对与要处理的块接触的块检测到的边缘的方向，并且解块滤波器被应用于块边界 按照确定的方向。