公开(公告)号：US20140112391A1

公开(公告)日：2014-04-24

申请号：US14123054

申请日：2012-06-22

申请人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

发明人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

IPC分类号： H04N19/587 ,  H04N19/51

CPC分类号： H04N19/182 ,  H04N19/117 ,  H04N19/139 ,  H04N19/172 ,  H04N19/523 ,  H04N19/82

摘要： The prediction error energy in inter-frame prediction with motion compensation is reduced and the coding efficiency is improved. A video encoding method using fractional-accuracy motion compensation includes: a step of performing a motion search to acquire a motion vector; a step of calculating reference probabilities at fractional-pixel positions designated by the acquired motion vector; a step of dividing interpolation positions which are fractional-pixel positions into multiple groups based on the calculated reference probabilities; a step of selecting, for each of the groups of the interpolation positions, interpolation filter coefficients to be used for generating an interpolated prediction picture from among multiple interpolation filter coefficient candidates; a step of generating the interpolated prediction picture using the selected interpolation filter coefficients and performing encoding with the fractional-accuracy motion compensation based on the interpolated prediction picture, for each of the groups of the interpolation positions; and a step of encoding information indicating grouping of the interpolation positions and information indicating interpolation filter coefficients to be used for each of the groups of the interpolation positions.

摘要翻译： 运动补偿的帧间预测中的预测误差能量降低，编码效率提高。 使用分数精度运动补偿的视频编码方法包括：执行运动搜索以获取运动矢量的步骤; 计算由所获取的运动矢量指定的分数像素位置处的参考概率的步骤; 基于所计算的参考概率将作为分数像素位置的插值位置分割成多个组的步骤; 对于每个所述插补位置组，从多个内插滤波器系数候选中选择用于生成内插预测图像的内插滤波器系数的步骤; 使用所选择的内插滤波器系数生成内插预测图像并基于内插预测图像对于每个插值位置的每一组执行基于分数精度运动补偿的编码的步骤; 以及编码指示内插位置分组的信息的步骤，以及指示要用于插值位置的组中的每一组的内插滤波器系数的信息的步骤。

公开(公告)号：US20140105308A1

公开(公告)日：2014-04-17

申请号：US14125463

申请日：2012-06-22

申请人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

发明人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

IPC分类号： H04N19/593

CPC分类号： H04N19/593 ,  H04N19/61 ,  H04N19/82

摘要： The prediction error energy in inter-frame prediction with motion compensation is reduced and the coding efficiency is improved. A video encoding method using fractional-accuracy motion compensation includes: a step of generating multiple weighted filter coefficients from multiple interpolation filter sets using weight parameters which designate weight values of interpolation filter coefficients; a step of selecting weighted filter coefficients which minimize prediction error energy in the fractional-accuracy motion compensation from among the weighted filter coefficients; a step of interpolating fractional-accuracy pixels for a reference picture by application of an interpolation filter with the selected weighted filter coefficients and encoding an input picture with the fractional-accuracy motion compensation; and a step of encoding the weight parameters used for generating the selected weighted filter coefficients and the interpolation filter coefficients and adding encoded weight parameters and encoded interpolation filter coefficients to an encoded bitstream.

摘要翻译： 运动补偿的帧间预测中的预测误差能量降低，编码效率提高。 使用分数精度运动补偿的视频编码方法包括：使用表示内插滤波器系数的权重值的权重参数从多个内插滤波器组生成多个加权滤波器系数的步骤; 从所述加权滤波器系数中选择使所述分数精度运动补偿中的预测误差能量最小化的加权滤波器系数的步骤; 通过使用具有所选择的加权滤波器系数的内插滤波器对参考图像内插分数精度像素并对具有分数精度运动补偿的输入图像进行编码的步骤; 以及编码用于生成所选择的加权滤波器系数和内插滤波器系数的加权参数并将编码的加权参数和编码的内插滤波器系数加到经编码比特流的步骤。

公开(公告)号：US09693053B2

公开(公告)日：2017-06-27

申请号：US14124331

申请日：2012-06-26

申请人： Yukihiro Bandoh ,  Shohei Matsuo ,  Seishi Takamura ,  Hirohisa Jozawa

发明人： Yukihiro Bandoh ,  Shohei Matsuo ,  Seishi Takamura ,  Hirohisa Jozawa

IPC分类号： H04N19/503 ,  H04N19/105 ,  H04N19/51 ,  H04N19/52 ,  H04N19/463 ,  H04N19/91

CPC分类号： H04N19/52 ,  H04N19/463 ,  H04N19/91

摘要： A video encoding device uses motion-compensated inter-frame prediction by dividing an image into blocks, each block a predetermined size, designating a first component value of a plurality of component values of a motion vector (MV) between an encoding target block and a neighboring block, designating a second component value, and encoding each first and second component values; a first component encoding means encodes a difference value of a first component and a second component encoding means, which obtains a probability of occurrence of a candidate value for the second component value of the MV of the encoding target block, based on a difference value between the first component value of the neighboring block MV and the first component value of the encoding target block MV and the second component value of the neighboring block MV, specifies a codeword of the second component value, encoding it based on the occurrence probability.

公开(公告)号：US09667963B2

公开(公告)日：2017-05-30

申请号：US14125463

申请日：2012-06-22

申请人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

发明人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

IPC分类号： H04N7/12 ,  H04N19/593 ,  H04N19/82 ,  H04N19/61

CPC分类号： H04N19/593 ,  H04N19/61 ,  H04N19/82

摘要： The prediction error energy in inter-frame prediction with motion compensation is reduced and the coding efficiency is improved. A video encoding method using fractional-accuracy motion compensation includes: a step of generating multiple weighted filter coefficients from multiple interpolation filter sets using weight parameters which designate weight values of interpolation filter coefficients; a step of selecting weighted filter coefficients which minimize prediction error energy in the fractional-accuracy motion compensation from among the weighted filter coefficients; a step of interpolating fractional-accuracy pixels for a reference picture by application of an interpolation filter with the selected weighted filter coefficients and encoding an input picture with the fractional-accuracy motion compensation; and a step of encoding the weight parameters used for generating the selected weighted filter coefficients and the interpolation filter coefficients and adding encoded weight parameters and encoded interpolation filter coefficients to an encoded bitstream.

公开(公告)号：US20130343470A1

公开(公告)日：2013-12-26

申请号：US14002921

申请日：2012-03-07

申请人： Masaaki Matsumura ,  Seishi Takamura ,  Atsushi Shimizu ,  Hirohisa Jozawa

发明人： Masaaki Matsumura ,  Seishi Takamura ,  Atsushi Shimizu ,  Hirohisa Jozawa

IPC分类号： H04N7/26 ,  G06T5/00

CPC分类号： H04N19/82 ,  G06T5/002 ,  G06T5/20 ,  H04N5/142 ,  H04N5/21 ,  H04N19/117 ,  H04N19/14 ,  H04N19/17 ,  H04N19/80

摘要： The computational complexity of a denoising filter is reduced while suppressing a reduction in coding efficiency. In an image processing apparatus, an edge direction detection unit calculates an edge direction using a denoising target image. A search shape setting unit sets a search shape in which the number of search points along the direction perpendicular to the edge direction is smaller than the number of search points along the edge direction, using the calculated edge direction as an index used for limiting the search shape. When noise of a target pixel is removed with a weight in accordance with the degree of template similarity between a template for the target pixel and a template for each of search points within a search shape and the weighted sum of pixel values at the search points, a filter execution unit executes a process of performing template matching on only search points within the set search shape and removing the noise of the target pixel.

摘要翻译： 降低去噪滤波器的计算复杂度，同时抑制编码效率的降低。 在图像处理装置中，边缘方向检测单元使用去噪目标图像来计算边缘方向。 搜索形状设置单元使用所计算的边缘方向作为用于限制搜索的索引来设置沿着与边缘方向垂直的方向上的搜索点的数量小于沿着边缘方向的搜索点的数量的搜索形状 形状。 当根据目标像素的模板与搜索形状中的每个搜索点的模板和搜索点处的像素值的加权和之间的模板相似度的重叠度来去除目标像素的噪声时， 滤波器执行单元执行仅对所设置的搜索形状内的搜索点执行模板匹配的处理，并且去除目标像素的噪声。

公开(公告)号：US10298945B2

公开(公告)日：2019-05-21

申请号：US13823623

申请日：2011-09-20

申请人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

发明人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

IPC分类号： H04N19/46 ,  H04N19/117 ,  H04N19/14 ,  H04N19/17 ,  H04N19/523 ,  H04N19/186 ,  H04N19/182

摘要： Regions based on which an interpolation method of a fractional-accuracy pixel is switched are optimized, and the interpolation method is switched for each of the divided regions, thereby reducing residual energy of inter-frame prediction with motion compensation. A video encoding apparatus is provided with: an encoding information acquiring unit which acquires encoding information for each block; a region classification unit which performs a region classification on a block-by-block basis in accordance with the encoding information; a divided region redefinition processing unit which shifts a region dividing line in a horizontal direction, a region dividing line in a vertical direction, or both the region dividing line in the horizontal direction and the region dividing line in the vertical direction based on a result of the region classification, and determines a region dividing line with which density of blocks belonging to a particular region classification is greater than or equal to a predetermined threshold value; an interpolation method switching unit which switches an interpolation method of a fractional-accuracy pixel for each of divided regions divided by the region dividing line; an interpolation performing unit which performs interpolation of the fractional-accuracy pixel for each of the divided regions; a picture encoding unit which encodes a picture using inter-frame prediction with motion compensation of fractional-accuracy for an interpolated picture; and a region classification information encoding unit which encodes information on the region classification.

公开(公告)号：US09609318B2

公开(公告)日：2017-03-28

申请号：US13814144

申请日：2011-08-10

申请人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

发明人： Shohei Matsuo ,  Yukihiro Bandoh ,  Seishi Takamura ,  Hirohisa Jozawa

IPC分类号： H04N7/26 ,  H04N19/50 ,  H04N19/117 ,  H04N19/14 ,  H04N19/523 ,  H04N19/59 ,  H04N19/176 ,  H04N19/119

CPC分类号： H04N19/50 ,  H04N19/117 ,  H04N19/119 ,  H04N19/14 ,  H04N19/176 ,  H04N19/523 ,  H04N19/59

摘要： A reduction in residual energy of inter-frame prediction with motion compensation and improvement in encoding efficiency are achieved by using a region-dividing type adaptive interpolation filter that takes an edge property of a picture into consideration. An edge calculation unit calculates edge information from reference picture data designated by a motion vector. A region dividing unit divides an encoding target frame into a plurality of regions that are units to which interpolation filters are adaptively applied based on the edge information. A filter coefficient optimizing unit optimizes an interpolation filter for a fractional-accuracy pixel for each of the regions. A reference picture interpolating unit interpolates the fractional-accuracy pixel of a reference picture using the optimized interpolation filter, and a predictive encoding unit performs predictive encoding using motion compensation of fractional-accuracy.

公开(公告)号：US09438912B2

公开(公告)日：2016-09-06

申请号：US14000624

申请日：2012-03-07

申请人： Masaaki Matsumura ,  Seishi Takamura ,  Atsushi Shimizu ,  Hirohisa Jozawa

发明人： Masaaki Matsumura ,  Seishi Takamura ,  Atsushi Shimizu ,  Hirohisa Jozawa

IPC分类号： H04N19/117 ,  H04N19/14 ,  H04N19/82 ,  G06T5/20 ,  H04N19/176

CPC分类号： H04N19/82 ,  G06T5/20 ,  H04N19/117 ,  H04N19/14 ,  H04N19/176

摘要： The computational complexity of a denoising filter is reduced while suppressing a reduction in coding efficiency. In a video encoding/decoding apparatus which uses a loop filter, a deviation degree calculating unit calculates the degree of deviation between a denoising target pixel and a surrounding pixel using a decoded image. A template shape setting unit limits a template shape so that its size is proportional to the degree of deviation relative to the maximum value of the degree of deviation in the decoded image. When noise of the target pixel is removed, weighted in accordance with the degree of similarity between a template of the target pixel and a template of each of search points in a search shape and the weighted sum of pixel values at the search points, the loop filter performs template matching using the limited template shape and removes noise of the target pixel.

摘要翻译： 降低去噪滤波器的计算复杂度，同时抑制编码效率的降低。 在使用环路滤波器的视频编码/解码装置中，偏差度计算单元使用解码图像来计算去噪对象像素和周围像素之间的偏离度。 模板形状设置单元限制模板形状，使得其尺寸与相对于解码图像中的偏离度的最大值的偏差度成比例。 当去除目标像素的噪声时，根据目标像素的模板与搜索形状中的每个搜索点的模板与搜索点处的像素值的加权和之间的相似度加权，循​​环 滤镜使用有限的模板形状执行模板匹配，并消除目标像素的噪点。

公开(公告)号：US20140133546A1

公开(公告)日：2014-05-15

申请号：US14125125

申请日：2012-06-12

申请人： Yukihiro Bandoh ,  Shohei Matsuo ,  Seishi Takamura ,  Hirohisa Jozawa

发明人： Yukihiro Bandoh ,  Shohei Matsuo ,  Seishi Takamura ,  Hirohisa Jozawa

IPC分类号： H04N19/147 ,  H04N19/182 ,  H04N19/577 ,  H04N19/117

CPC分类号： H04N19/176 ,  H04N19/117 ,  H04N19/147 ,  H04N19/15 ,  H04N19/182 ,  H04N19/577 ,  H04N19/59

摘要： A video encoding device includes means used to estimate a lower limit of a bit amount/distortion cost function when an adaptive interpolation filter (AIF) is used based on a generated bit amount and an encoding distortion amount when a region-based adaptive interpolation filter (RBAIF) is used upon selecting an optimum IF based on a bit amount/distortion cost function among a fixed interpolation filter (IF), the AIF, and the RBAIF, and means used to select an optimum IF based on a comparison of bit amount/distortion cost functions of the fixed IF and the RBAIF when the lower limit is a value greater than the bit amount/distortion cost function for the fixed IF, and selecting an optimum IF based on a comparison of bit amount/distortion functions of the fixed IF, the AIF, and the RBAIF only when the lower limit is less than or equal to the bit amount/distortion cost function for the fixed IF.

摘要翻译： 视频编码装置包括：当基于区域的自适应内插滤波器（A）的基于生成的比特量和编码失真量使用自适应内插滤波器（AIF）时，用于估计比特量/失真成本函数的下限的装置 RIBIF）用于在固定内插滤波器（IF），AIF和RBAIF中基于比特量/失真成本函数选择最佳IF，以及用于基于比特量/比特率的比较来选择最佳IF的装置， 当下限是大于固定IF的位数/失真成本函数的值时，固定IF和RBAIF的失真成本函数，以及基于固定IF的比特量/失真函数的比较来选择最佳IF ，AIF和RBAIF，只有当下限小于或等于固定IF的位数/失真成本函数时。

公开(公告)号：US06456658B2

公开(公告)日：2002-09-24

申请号：US09832451

申请日：2001-04-11

申请人： Kazuto Kamikura ,  Hiroshi Watanabe ,  Hirohisa Jozawa

发明人： Kazuto Kamikura ,  Hiroshi Watanabe ,  Hirohisa Jozawa

IPC分类号： H04N718

CPC分类号： H04N19/162 ,  H04N19/105 ,  H04N19/142 ,  H04N19/172 ,  H04N19/176 ,  H04N19/46 ,  H04N19/51 ,  H04N19/61

摘要： A moving image brightness variation compensation method for encoding digital moving images for transmission and storage, and for image processing when editing moving images, the moving image brightness variation compensation method comprising a step of compensating for overall brightness variations by correcting a luminance value x of each pixel according to the formula DC·x+DB, wherein DB is a parameter indicating a gain change and DC is a parameter indicating a contrast change, the parameters representing overall luminance changes between a reference image plane and an image plane being processed.

摘要翻译： 一种运动图像亮度变化补偿方法，用于编码用于发送和存储的数字运动图像，以及用于编辑运动图像时的图像处理，所述运动图像亮度变化补偿方法包括以下步骤：通过校正每个 像素，其中DB是表示增益变化的参数，DC是表示对比度变化的参数，表示正在处理的参考图像平面和图像平面之间的整体亮度变化的参数。