公开(公告)号：US08780995B2

公开(公告)日：2014-07-15

申请号：US12963138

申请日：2010-12-08

申请人： Tomonobu Yoshino ,  Sei Naito ,  Shigeyuki Sakazawa

发明人： Tomonobu Yoshino ,  Sei Naito ,  Shigeyuki Sakazawa

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66 ,  G06K9/36 ,  G06K9/46

CPC分类号： H04N19/117 ,  H04N19/139 ,  H04N19/176 ,  H04N19/523 ,  H04N19/61

摘要： It is a purpose of the present invention to provide a video encoding apparatus and a video decoding apparatus which are capable of providing real-time processing having improved coding performance. A video encoding apparatus AA includes an inter-encoding predicted value generating unit 2 configured to receive, as input signals, an input image a, a local decoded value d acquired from an encoded block, prediction direction information e acquired from the encoded block, and interpolation filter initial control information b. The inter-encoding predicted value generating unit 2 includes a filter control unit 21. The filter control unit 21 extracts the tap size N of the interpolation filter and the initial value c0(i,j) of the filter coefficient of the interpolation filter from the interpolation filter initial control information b, and uses the initial value c0(i,j) of the filter coefficient of the interpolation filter as the filter coefficient c(i,j) of the interpolation filter.

摘要翻译： 本发明的目的是提供能够提供具有改进的编码性能的实时处理的视频编码装置和视频解码装置。 视频编码装置AA包括帧间编码预测值生成单元2，其被配置为接收输入图像a，从编码块获取的局部解码值d，从编码块获取的预测方向信息e，以及 内插滤波器初始控制信息b。 帧间编码预测值生成单元2包括滤波器控制单元21.滤波器控制单元21从插值滤波器的抽头尺寸N提取内插滤波器的滤波器系数的初始值c0（i，j） 内插滤波器初始控制信息b，并且使用内插滤波器的滤波器系数的初始值c0（i，j）作为内插滤波器的滤波器系数c（i，j）。

公开(公告)号：US20100322316A1

公开(公告)日：2010-12-23

申请号：US12814634

申请日：2010-06-14

申请人： Tomonobu Yoshino ,  Sei Naito ,  Shigeyuki Sakazawa

发明人： Tomonobu Yoshino ,  Sei Naito ,  Shigeyuki Sakazawa

IPC分类号： H04N7/32

CPC分类号： H04N19/18 ,  H04N19/103 ,  H04N19/132 ,  H04N19/176 ,  H04N19/46 ,  H04N19/513 ,  H04N19/61

摘要： As the encoding mode, a moving-picture encoding apparatus includes an encoding mode that relies only on inference based on encoding information of a previously encoded unit block so as to encode a picture of a unit block. The encoding information in this encoding mode is imparted with secondary encoding information for improving the prediction performance, e.g., MV information. The MV information is produced by an MV-information producing unit 21 to which an input picture and MV information in a previously encoded MB are input. A locally-decoded picture producing unit 22 produces a locally-decoded picture (pixel value) of the previously encoded MB. As the secondary encoding information, a DC component of an orthogonal transformation result relative to a prediction error or a value equivalent to an average value of prediction errors can also be used.

摘要翻译： 作为编码模式，运动图像编码装置包括仅基于推断的编码模式，该编码模式基于先前编码的单位块的编码信息，以对单位块的图像进行编码。 该编码模式中的编码信息被赋予用于改善预测性能的辅助编码信息，例如MV信息。 MV信息由输入图像和先前编码的MB中的MV信息的MV信息产生单元21产生。 本地解码图像产生单元22产生先前编码的MB的本地解码的图像（像素值）。 作为二次编码信息，也可以使用相对于预测误差的正交变换结果的DC分量或与预测误差的平均值相当的值。

公开(公告)号：US20110228859A1

公开(公告)日：2011-09-22

申请号：US13048331

申请日：2011-03-15

申请人： Osamu Sugimoto ,  Sei Naito ,  Shigeyuki Sakazawa

发明人： Osamu Sugimoto ,  Sei Naito ,  Shigeyuki Sakazawa

IPC分类号： H04N7/26

CPC分类号： H04N19/154 ,  H04N19/159 ,  H04N19/176 ,  H04N19/18 ,  H04N19/48

摘要： An objective image quality assessment device of a video quality for estimating a subjective image quality from compressed bit stream is provided. The device includes a macro-block layer parameter analyzer for acquiring a quantizer scale size defined with respect to each macro-block and a coding type of a slice from a compressed bit stream, an orthogonal transformation coefficient in each macro-block, and a reference frame number in the macro-block applied with a motion compensating prediction, an average quantizer scale calculator for obtaining an average in a sequence of the quantizer scale size for every coding type of the slice, a spatial degradation feature calculator and a temporal degradation feature calculator for obtaining a spatial degradation feature and a temporal degradation feature, in each macro-block, and an image feature integrator for deriving the objective image quality based on the features obtained in the calculators.

摘要翻译： 提供了一种用于从压缩比特流估计主观图像质量的视频质量的客观图像质量评估装置。 该装置包括宏块层参数分析器，用于获取关于每个宏块定义的量化器尺度尺度和来自压缩比特流的切片的编码类型，每个宏块中的正交变换系数和参考 应用了运动补偿预测的宏块中的帧号，平均量化器比例计算器，用于获得每个片的编码类型的量化器尺度尺度的平均值，空间退化特征计算器和时间退化特征计算器 用于获得每个宏块中的空间退化特征和时间退化特征，以及用于基于在计算器中获得的特征导出目标图像质量的图像特征积分器。

公开(公告)号：US08737486B2

公开(公告)日：2014-05-27

申请号：US13048331

申请日：2011-03-15

申请人： Osamu Sugimoto ,  Sei Naito ,  Shigeyuki Sakazawa

发明人： Osamu Sugimoto ,  Sei Naito ,  Shigeyuki Sakazawa

IPC分类号： H04N7/26

CPC分类号： H04N19/154 ,  H04N19/159 ,  H04N19/176 ,  H04N19/18 ,  H04N19/48

摘要： An objective image quality assessment device of a video quality for estimating a subjective image quality from compressed bit stream is provided. The device includes a macro-block layer parameter analyzer for acquiring a quantizer scale size defined with respect to each macro-block and a coding type of a slice from a compressed bit stream, an orthogonal transformation coefficient in each macro-block, and a reference frame number in the macro-block applied with a motion compensating prediction, an average quantizer scale calculator for obtaining an average in a sequence of the quantizer scale size for every coding type of the slice, a spatial degradation feature calculator and a temporal degradation feature calculator for obtaining a spatial degradation feature and a temporal degradation feature, in each macro-block, and an image feature integrator for deriving the objective image quality based on the features obtained in the calculators.

摘要翻译： 提供了一种用于从压缩比特流估计主观图像质量的视频质量的客观图像质量评估装置。 该装置包括宏块层参数分析器，用于获取关于每个宏块定义的量化器尺度尺度和来自压缩比特流的切片的编码类型，每个宏块中的正交变换系数和参考 应用了运动补偿预测的宏块中的帧号，平均量化器比例计算器，用于获得每个片的编码类型的量化器尺度尺度的平均值，空间退化特征计算器和时间退化特征计算器 用于获得每个宏块中的空间退化特征和时间退化特征，以及用于基于在计算器中获得的特征导出目标图像质量的图像特征积分器。

公开(公告)号：US20080240238A1

公开(公告)日：2008-10-02

申请号：US12054756

申请日：2008-03-25

申请人： Tomonobu Yoshino ,  Sei Naito ,  Atsushi Koike

发明人： Tomonobu Yoshino ,  Sei Naito ,  Atsushi Koike

IPC分类号： H04N7/12

CPC分类号： H04N19/136 ,  H04N19/11 ,  H04N19/176 ,  H04N19/61

摘要： There is provided an intra prediction system having high prediction performance and satisfactory encoding efficiency in a pattern image in which pixel value is periodically changed and a pattern image in which pixel value has a constant change tendency like gradation effect. A frequency component extraction unit allows a pixel value of an encoded MB to be made one-dimensional for one-dimensional orthogonal conversion. A frequency component-considering prediction value calculation unit receives, as inputs, a pixel value of an encoded adjacent MB and an alternating current frequency component output to create an orthogonal conversion coefficient. The orthogonal conversion coefficient then is subjected inverted orthogonal conversion (IDCT) to generate a prediction value p(i). A prediction direction determination unit selects and outputs a prediction value p′ (i) in a prediction direction having the highest encoding efficiency among a conventional prediction value calculation unit and a prediction value calculation unit according to the present invention.

摘要翻译： 提供一种在像素值周期性变化的图案图像中具有高预测性能和令人满意的编码效率的帧内预测系统以及其中像素值具有恒定变化趋势的图案图像，如灰度效果。 频率分量提取单元允许将编码的MB的像素值制成一维用于一维正交变换。 频率分量考虑预测值计算单元接收编码的相邻MB的像素值和输出的交流频率分量作为输入，以产生正交变换系数。 然后对正交变换系数进行反向正交变换（IDCT），生成预测值p（i）。 预测方向确定单元根据本发明在常规预测值计算单元和预测值计算单元中选择并输出具有最高编码效率的预测方向的预测值p'（i）。

公开(公告)号：US09014268B2

公开(公告)日：2015-04-21

申请号：US12727278

申请日：2010-03-19

申请人： Sei Naito ,  Tomonobu Yoshino

发明人： Sei Naito ,  Tomonobu Yoshino

IPC分类号： H04N7/50 ,  H04N19/567 ,  H04N19/176 ,  H04N19/119 ,  H04N19/147 ,  H04N19/103 ,  H04N19/14 ,  H04N19/53

CPC分类号： H04N19/567 ,  H04N19/103 ,  H04N19/119 ,  H04N19/14 ,  H04N19/147 ,  H04N19/176 ,  H04N19/53

摘要： A video encoder according to the present invention improves coding efficiency of a super high definition video by setting an area of MB size and optimally determining size of the area. A locally decoded image (a) is subjected to frequency analysis in a frequency analyzing unit. Based on the result, an area setting unit sets a local area in a picture to which the maximum MB size is applied. An area boundary correcting unit corrects an area boundary in accordance with a representative motion characteristic, and an N-value calculating unit determines the maximum MB size (N×N) of each area based on a result of encoding a neighboring picture. The area setting and the N-value calculation are performed step by step.

摘要翻译： 根据本发明的视频编码器通过设置MB大小的面积并且最佳地确定区域的大小来提高超高分辨率视频的编码效率。 在频率分析单元中对本地解码图像（a）进行频率分析。 基于该结果，区域设置单元设置应用了最大MB大小的图片中的局部区域。 区域边界校正单元根据代表运动特性校正区域边界，并且N值计算单元基于对相邻图像进行编码的结果来确定每个区域的最大MB大小（N×N）。 进行区域设定和N值运算。

公开(公告)号：US08199818B2

公开(公告)日：2012-06-12

申请号：US12054756

申请日：2008-03-25

申请人： Tomonobu Yoshino ,  Sei Naito ,  Atsushi Koike

发明人： Tomonobu Yoshino ,  Sei Naito ,  Atsushi Koike

IPC分类号： H04B1/66

CPC分类号： H04N19/136 ,  H04N19/11 ,  H04N19/176 ,  H04N19/61

摘要： There is provided an intra prediction system having high prediction performance and satisfactory encoding efficiency in a pattern image in which pixel value is periodically changed and a pattern image in which pixel value has a constant change tendency like gradation effect. A frequency component extraction unit allows a pixel value of an encoded MB to be made one-dimensional for one-dimensional orthogonal conversion. A frequency component-considering prediction value calculation unit receives, as inputs, a pixel value of an encoded adjacent MB and an alternating current frequency component output to create an orthogonal conversion coefficient. The orthogonal conversion coefficient then is subjected inverted orthogonal conversion (IDCT) to generate a prediction value p(i). A prediction direction determination unit selects and outputs a prediction value p′(i) in a prediction direction having the highest encoding efficiency among a conventional prediction value calculation unit and a prediction value calculation unit according to the present invention.

摘要翻译： 提供一种在像素值周期性变化的图案图像中具有高预测性能和令人满意的编码效率的帧内预测系统以及其中像素值具有恒定变化趋势的图案图像，如灰度效果。 频率分量提取单元允许将编码的MB的像素值制成一维用于一维正交变换。 频率分量考虑预测值计算单元接收编码的相邻MB的像素值和输出的交流频率分量作为输入，以产生正交变换系数。 然后对正交变换系数进行反向正交变换（IDCT），生成预测值p（i）。 预测方向确定单元根据本发明在常规预测值计算单元和预测值计算单元中选择并输出具有最高编码效率的预测方向的预测值p'（i）。

公开(公告)号：US20100246684A1

公开(公告)日：2010-09-30

申请号：US12727278

申请日：2010-03-19

申请人： Sei Naito ,  Tomonobu Yoshino

发明人： Sei Naito ,  Tomonobu Yoshino

IPC分类号： H04N7/50

CPC分类号： H04N19/567 ,  H04N19/103 ,  H04N19/119 ,  H04N19/14 ,  H04N19/147 ,  H04N19/176 ,  H04N19/53

摘要： A video encoder according to the present invention improves coding efficiency of a super high definition video by setting an area of MB size and optimally determining size of the area. A locally decoded image (a) is subjected to frequency analysis in a frequency analyzing unit. Based on the result, an area setting unit sets a local area in a picture to which the maximum MB size is applied. An area boundary correcting unit corrects an area boundary in accordance with a representative motion characteristic, and an N-value calculating unit determines the maximum MB size (N×N) of each area based on a result of encoding a neighboring picture. The area setting and the N-value calculation are performed step by step.

摘要翻译： 根据本发明的视频编码器通过设置MB大小的面积并且最佳地确定区域的大小来提高超高分辨率视频的编码效率。 在频率分析单元中对本地解码图像（a）进行频率分析。 基于该结果，区域设置单元设置应用了最大MB大小的图片中的局部区域。 区域边界校正单元根据代表运动特性校正区域边界，并且N值计算单元基于对相邻图像进行编码的结果来确定每个区域的最大MB大小（N×N）。 进行区域设定和N值运算。

公开(公告)号：US20120051426A1

公开(公告)日：2012-03-01

申请号：US13212512

申请日：2011-08-18

申请人： Koichi Takagi ,  Sei Naito ,  Osamu Sugimoto

发明人： Koichi Takagi ,  Sei Naito ,  Osamu Sugimoto

IPC分类号： H04N7/32 ,  H04N7/64

CPC分类号： H04N19/18 ,  H04N19/107 ,  H04N19/132 ,  H04N19/136 ,  H04N19/147 ,  H04N19/172 ,  H04N19/46 ,  H04N19/61

摘要： A sharp/blurred frame mode classifying unit specifies a frame to be subjected to sharp or blurred process. A 3D video signal extracting unit extracts a predetermined area or predetermined macro block in the specified target frame, and a 3D FFT 15 frequency-converts it to acquire a coefficient string. An intersection coordinate calculating unit finds a non-perceptible high frequency coefficient based on a spatio-temporal visual property model for the coefficient string, and a coefficient cut processing unit cuts the non-perceptible high frequency coefficient for a frequency conversion coefficient of orthogonal conversion of a predictive error signal. The code amount of a video signal is largely reduced for a high frame rate video by the processings only at the encode side without deteriorating the picture quality.

摘要翻译： 锐利/模糊的帧模式分类单元指定要进行尖锐或模糊处理的帧。 3D视频信号提取单元提取指定目标帧中的预定区域或预定宏块，并且3D FFT 15对其进行频率转换以获取系数串。 交叉点坐标计算单元基于用于系数串的时空视觉属性模型来找到不可感知的高频系数，并且系数切换处理单元切换用于正交转换的频率转换系数的不可感知的高频系数 预测误差信号。 通过仅在编码侧的处理，高帧率视频的视频信号的编码量大大降低，而不会降低画面质量。

公开(公告)号：US07675540B2

公开(公告)日：2010-03-09

申请号：US10898166

申请日：2004-07-26

申请人： Atsushi Matsumura ,  Sei Naito ,  Ryoichi Kawada ,  Atsushi Koike ,  Shuichi Matsumoto

发明人： Atsushi Matsumura ,  Sei Naito ,  Ryoichi Kawada ,  Atsushi Koike ,  Shuichi Matsumoto

IPC分类号： H04N13/04 ,  G06T15/40 ,  G09G5/00

CPC分类号： G06T15/20 ,  H04N13/111

摘要： A sender produces a background video image 4 from a reference video image 1 and a depth map 3 and synthesizes the background video image 4 in a background buffer 5. A projection converting matrix 6 for synthesizing is calculated. A receiver receives the reference video image 1, the depth map 3 and the projection converting matrix 6. The receiver produces a free viewpoint video image 11 and a background video image 12. The background buffer 13 is dynamically renewed. The free viewpoint video image 11 and the image in the background buffer 13 are synthesized with each other, and the background video image in the concealed regions in the free viewpoint video image are complemented to obtain the complemented image 14.

摘要翻译： 发送者从参考视频图像1和深度图3生成背景视频图像4，并在背景缓冲器5中合成背景视频图像4.计算用于合成的投影转换矩阵6。 接收器接收参考视频图像1，深度图3和投影转换矩阵6.接收器产生空闲视点视频图像11和背景视频图像12.背景缓冲器13被动态地更新。 自由视点图像11和背景缓冲器13中的图像彼此合成，并且对自由视点视频图像中的隐藏区域中的背景视频图像进行补码以获得补码图像14。