公开(公告)号：US09088797B2

公开(公告)日：2015-07-21

申请号：US13119757

申请日：2008-12-19

申请人： Kai Zhang ,  Li Zhang ,  Siwei Ma ,  Wen Gao ,  Shaw-Min Lei

发明人： Kai Zhang ,  Li Zhang ,  Siwei Ma ,  Wen Gao ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N7/50 ,  H04N19/51

CPC分类号： H04N19/51 ,  H04N19/593

摘要： A video processing apparatus with residue prediction includes a motion estimation/compensation unit to determine a matching block of a reference video frame, obtain a motion vector of a current block of a current video frame that is related to the matching block, and acquire neighboring reconstructed pixels adjacent to the current block and corresponding pixels adjacent to the matching block with the motion vector alignment. Additionally, a pseudo-residue generating unit is included and constructs pseudo residues according to the neighboring reconstructed pixels and the corresponding pixels, an arithmetic unit is included and generates first-order residues by subtracting the matching block from the current block, and a residue-predicting unit is included and derives second-order residues and corresponding information according to the pseudo residues and the first-order residues. Moreover, a post-processing unit is included and derives a reconstructed current block according to the second-order residues and its corresponding information.

摘要翻译： 具有残差预测的视频处理装置包括运动估计/补偿单元，用于确定参考视频帧的匹配块，获得与匹配块相关的当前视频帧的当前块的运动矢量，并且获取邻近重构的 与当前块相邻的像素和与匹配块相邻的对应像素与运动矢量对准。 另外，包括伪残差生成单元，根据相邻的重构像素和对应的像素构成伪残差，包括算术单位，并通过从当前块中减去匹配块来生成一阶残差， 包含预测单元，并根据伪残差和一阶残差导出二阶残差和相应信息。 此外，包括后处理单元，并根据二阶残差及其对应信息导出重构的当前块。

公开(公告)号：US20110170606A1

公开(公告)日：2011-07-14

申请号：US13119757

申请日：2008-12-19

申请人： Kai Zhang ,  Li Zhang ,  Siwei Ma ,  Wen Gao ,  Shaw-Min Lei

发明人： Kai Zhang ,  Li Zhang ,  Siwei Ma ,  Wen Gao ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N7/50

CPC分类号： H04N19/51 ,  H04N19/593

摘要： A video processing apparatus with residue prediction includes a motion estimation/compensation unit to determine a matching block of a reference video frame, obtain a motion vector of a current block of a current video frame that is related to the matching block, and acquire neighboring reconstructed pixels adjacent to the current block and corresponding pixels adjacent to the matching block with the motion vector alignment. Additionally, a pseudo-residue generating unit is included and constructs pseudo residues according to the neighboring reconstructed pixels and the corresponding pixels, an arithmetic unit is included and generates first-order residues by subtracting the matching block from the current block, and a residue-predicting unit is included and derives second-order residues and corresponding information according to the pseudo residues and the first-order residues. Moreover, a post-processing unit is included and derives a reconstructed current block according to the second-order residues and its corresponding information.

摘要翻译： 具有残差预测的视频处理装置包括运动估计/补偿单元，用于确定参考视频帧的匹配块，获得与匹配块相关的当前视频帧的当前块的运动矢量，并且获取邻近重构的 与当前块相邻的像素和与匹配块相邻的对应像素与运动矢量对准。 另外，包括伪残差生成单元，根据相邻的重构像素和对应的像素构成伪残差，包括算术单位，并通过从当前块中减去匹配块来生成一阶残差， 包含预测单元，并根据伪残差和一阶残差导出二阶残差和相应信息。 此外，包括后处理单元，并根据二阶残差及其对应信息导出重构的当前块。

公开(公告)号：US09723313B2

公开(公告)日：2017-08-01

申请号：US13452198

申请日：2012-04-20

申请人： Mingyuan Yang ,  Dong Wang ,  Lianhuan Xiong ,  Xin Zhao ,  Li Zhang ,  Siwei Ma ,  Wen Gao

发明人： Mingyuan Yang ,  Dong Wang ,  Lianhuan Xiong ,  Xin Zhao ,  Li Zhang ,  Siwei Ma ,  Wen Gao

IPC分类号： H04N19/136 ,  H04N19/159 ,  H04N19/176 ,  H04N19/147 ,  H04N19/46 ,  H04N19/122 ,  H04N19/61

CPC分类号： H04N19/136 ,  H04N19/122 ,  H04N19/147 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46 ,  H04N19/61

摘要： The embodiments of the present invention provide a method and a device for encoding and decoding videos, and relate to the communication field, and an efficient transformation matrix corresponding to features of each residual block is selected for transformation, which therefore improves encoding efficiency. The solution provided in an embodiment of the present invention is: generating a prediction residual according to input video data; selecting a set of best transformation matrixes among multiple candidate transformation matrixes according to an intra-frame prediction mode and rate-distortion criteria to perform transform-coding on the prediction residual and obtain a transformation result; and generating an encoded stream according to the transformation result and selected transformation matrix index information.

公开(公告)号：US20070200737A1

公开(公告)日：2007-08-30

申请号：US10572440

申请日：2004-07-05

申请人： Wen Gao ,  Debin Zhao ,  Qiang Wang ,  Siwei Ma ,  Yan Lu

发明人： Wen Gao ,  Debin Zhao ,  Qiang Wang ,  Siwei Ma ,  Yan Lu

IPC分类号： H03M7/00

CPC分类号： H04N19/186 ,  H04N19/13 ,  H04N19/159 ,  H04N19/176 ,  H04N19/61

摘要： The present invention provides an entropy coding method for coding video prediction residual coefficients, comprising the steps of: firstly, zig-zag scanning coefficients of blocks to be coded to form a sequence of (level, run) pairs; secondly, selecting a type of code table for coding a current image block to be coded according to a type of macro block; then switching and coding each (level, run) pair in the obtained sequence of (level, run) pairs with multiple tables, with the reverse zig-zag scanning order for the coding order of the pairs; at last, coding a flag of End of Block EOB with the current code table. The present invention of an entropy coding method for coding video prediction residual coefficients fully considers the context information and the rules of symbol's conditional probability distribution by designing different tables for different block types and different regions of level. The coding efficiency is improved and no impact to computational implementation complexity is involved.

摘要翻译： 本发明提供了一种用于对视频预测残差系数进行编码的熵编码方法，包括以下步骤：首先，要编码的块的Z字形扫描系数形成（级，运行）对的序列; 其次，根据宏块的类型选择用于编码要编码的当前图像块的码表类型; 然后在所获得的（多个表中）对的序列中对每个（电平，运行）对进行切换和编码，其中用于编码顺序的反向Z字形扫描顺序; 最后用当前代码表编码块EOB结束标志。 用于编码视频预测残差系数的熵编码方法的本发明通过为不同的块类型和不同的级别的区域设计不同的表格来充分地考虑上下文信息和符号的条件概率分布规则。 编码效率得到提高，对计算实现的复杂性没有影响。

公开(公告)号：US07974344B2

公开(公告)日：2011-07-05

申请号：US10584777

申请日：2004-07-08

申请人： Xiangyang Ji ,  Wen Gao ,  Siwei Ma ,  Debin Zhao ,  Yan Lu

发明人： Xiangyang Ji ,  Wen Gao ,  Siwei Ma ,  Debin Zhao ,  Yan Lu

IPC分类号： H04N7/12

CPC分类号： H04N19/577

摘要： A “rounding to zero” method can maintain the exact motion vector and can also be achieved by the method without division so as to improve the precision of calculating the motion vector, embody the motion of the object in video more factually, and obtain the more accurate motion vector prediction. Combining with the forward prediction coding and the backward prediction coding, the present invention realizes a new prediction coding mode, which can guarantee the high efficiency of coding in direct mode as well as is convenient for hardware realization, and gains the same effect as the conventional B frame coding.

摘要翻译： “舍入到零”方法可以保持精确的运动矢量，也可以通过不分割的方法来实现，以提高计算运动矢量的精度，更实际地体现视频中物体的运动，并获得更多 准确的运动矢量预测。 结合前向预测编码和后向预测编码，本发明实现了一种新的预测编码模式，可以保证直接模式下的编码效率高，便于硬件实现，并获得与常规编码相同的效果 B帧编码。

公开(公告)号：US20060088099A1

公开(公告)日：2006-04-27

申请号：US10521877

申请日：2002-09-23

申请人： Wen Gao ,  Siwei Ma ,  Yan Lu

发明人： Wen Gao ,  Siwei Ma ,  Yan Lu

IPC分类号： H04N11/02 ,  H04N7/12 ,  H04N11/04 ,  H04B1/66

CPC分类号： H04N19/567 ,  H04N19/107 ,  H04N19/124 ,  H04N19/14 ,  H04N19/147 ,  H04N19/15 ,  H04N19/152 ,  H04N19/172 ,  H04N19/176 ,  H04N19/19 ,  H04N19/194 ,  H04N19/61

摘要： In the invention, a rate distortion optimization (RDO) based rate control scheme is comprised of following two steps: first, does bit allocation for every frame in a GOP, and based on the allocated bits, a predicted quantization parameter is used to do the first rate distortion optimization mode selection for every macroblock in the current frame; second, the information of the current macroblock collected from the first rate distortion mode selection is used to calculate a final quantization parameter for rate control, and if the final quantization parameter is different from the predicted one, a second rate distortion mode selection will be executed again. A rate distortion optimization based rate control implementation includes following modules: a video coding encoder module(for example, H.264/JVT processing module), rate distortion optimization based macroblock mode selection and adaptive quantization module, virtual buffer, and global complexity estimation module. As RDO and rate control are considered together in the invention, the RDO based rate control scheme can achieve better coding performance while with accurate target bitrate control.

摘要翻译： 在本发明中，基于速率失真优化（RDO）的速率控制方案包括以下两个步骤：首先，对GOP中的每个帧执行比特分配，并且基于所分配的比特，使用预测的量化参数来执行 对当前帧中的每个宏块进行一次失真优化模式选择; 第二，使用从第一速率失真模式选择收集的当前宏块的信息来计算用于速率控制的最终量化参数，并且如果最终量化参数与预测的量化参数不同，则将执行第二速率失真模式选择 再次。 基于速率失真优化的速率控制实现包括以下模块：视频编码编码器模块（例如，H.264 / JVT处理模块），基于速率失真优化的宏块模式选择和自适应量化模块，虚拟缓冲器和全局复杂度估计模块 。 由于在本发明中一起考虑了RDO和速率控制，所以基于RDO的速率控制方案可以在精确的目标比特率控制的情况下实现更好的编码性能。

公开(公告)号：US08306124B2

公开(公告)日：2012-11-06

申请号：US10584844

申请日：2004-07-08

申请人： Wen Gao ,  Junhao Zheng ,  Siwei Ma ,  Xiangyang Ji ,  Peng Zhang ,  Yan Lu

发明人： Wen Gao ,  Junhao Zheng ,  Siwei Ma ,  Xiangyang Ji ,  Peng Zhang ,  Yan Lu

IPC分类号： H04N7/12

CPC分类号： H04N19/132 ,  H04N19/176 ,  H04N19/51 ,  H04N19/61 ,  H04N19/70

摘要： An encoding method for skipped macroblocks in a video image includes the steps of: adding one indication bit into a picture header for indicating a coding mode for skipped macroblocks in a current image; selecting the coding mode for a macroblock type in the current image according to the number of skipped macroblocks, if it is a run_length coding, then setting the indication bit of the picture header as a status indicating a run_length coding, and encoding the macroblock type in the image by the run_length coding mode; if it is a joint coding, then setting the indication bit of the picture header as status indicating a joint coding and encoding the macroblock type in the image by the joint coding mode of the number of skipped macroblocks and the macroblock type; finally, encoding other data in the current macroblock and writing data into a code stream.

摘要翻译： 视频图像中的跳过宏块的编码方法包括以下步骤：将一个指示位添加到用于指示当前图像中的跳过宏块的编码模式的图像头中; 根据跳过的宏块的数量，选择当前图像中的宏块类型的编码模式，如果是长度编码，则将图像头的指示位设置为指示运行长度编码的状态，并将宏块类型编码 图像由run_length编码模式; 如果是联合编码，则通过跳过的宏块的数量和宏块类型的联合编码模式将图像头的指示位设置为指示图像中的宏块类型的联合编码和编码的状态; 最后，编码当前宏块中的其他数据并将数据写入代码流。

公开(公告)号：US20090304083A1

公开(公告)日：2009-12-10

申请号：US10584777

申请日：2004-07-08

申请人： Wen Gao ,  Xiangyang Ji ,  Siwei Ma ,  Debin Zhao ,  Yan Lu

发明人： Wen Gao ,  Xiangyang Ji ,  Siwei Ma ,  Debin Zhao ,  Yan Lu

IPC分类号： H04N7/26

CPC分类号： H04N19/577

摘要： The present invention discloses a “rounding to zero” method which can maintain the exact motion vector and can also be achieved by the method without division so as to improve the precision of calculating the motion vector, embody the motion of the object in video more factually, and obtain the more accurate motion vector prediction. Combining with the forward prediction coding and the backward prediction coding, the present invention realizes a new prediction coding mode, which can guarantee the high efficiency of coding in direct mode as well as is convenient for hardware realization, and gains the same effect as the conventional B frame coding.

摘要翻译： 本发明公开了一种“舍入到零”方法，其可以保持精确的运动矢量，并且还可以通过不分割的方法来实现，以便提高计算运动矢量的精度，更实际地体现视频中的对象的运动 ，并获得更准确的运动矢量预测。 结合前向预测编码和后向预测编码，本发明实现了一种新的预测编码模式，可以保证直接模式下的编码效率高，便于硬件实现，并获得与常规编码相同的效果 B帧编码。

公开(公告)号：US20070110156A1

公开(公告)日：2007-05-17

申请号：US10571659

申请日：2004-07-02

申请人： Xiangyang Ji ,  Wen Gao ,  Debin Zhao ,  Yan Lu ,  Siwei Ma ,  Honggang Qi

发明人： Xiangyang Ji ,  Wen Gao ,  Debin Zhao ,  Yan Lu ,  Siwei Ma ,  Honggang Qi

IPC分类号： H04N11/04 ,  H04N11/02

CPC分类号： H04N19/577 ,  H04N19/513 ,  H04N19/58 ,  H04N19/61

摘要： The invention discloses a bi-directional prediction method for video coding/decoding. When bi-directional prediction coding at the coding end, firstly the given forward candidate motion vector of the current image block is obtained for every image block of the current B-frame; the backward candidate motion vector is obtained through calculation, and the candidate bi-directional prediction reference block is obtained through bi-directional prediction method; the match is computed within the given searching scope and/or the given matching threshold; finally the optimal matching block is selected to determine the final forward motion vector, and the backward motion vector and the block residual. The present invention achieves the object of bi-directional prediction by coding a single motion vector, furthermore, it will not enhance the complexity of searching for a matching block at the coding end, and may save amount of coding the motion vector and represent the motion of the objects in video more actually. The present invention realizes a new prediction coding type by combining the forward prediction coding with the backward.

摘要翻译： 本发明公开了一种用于视频编码/解码的双向预测方法。 在编码结束的双向预测编码时，首先为当前B帧的每个图像块获得当前图像块的给定正向候选运动矢量; 通过计算获得后向候选运动矢量，通过双向预测方法获得候选双向预测参考块; 在给定的搜索范围和/或给定的匹配阈值内计算匹配; 最后选择最优匹配块来确定最终的前向运动矢量，反向运动矢量和块残差。 本发明通过对单个运动矢量进行编码来实现双向预测的目的，此外，它不会增强在编码端搜索匹配块的复杂度，并且可以节省编码运动矢量的量并表示运动 视频中的对象更实际。 本发明通过将前向预测编码与后向组合来实现新的预测编码类型。

公开(公告)号：US07974343B2

公开(公告)日：2011-07-05

申请号：US10572440

申请日：2004-07-05

申请人： Wen Gao ,  Debin Zhao ,  Qiang Wang ,  Siwei Ma ,  Yan Lu

发明人： Wen Gao ,  Debin Zhao ,  Qiang Wang ,  Siwei Ma ,  Yan Lu

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N13/02 ,  H04N13/04

CPC分类号： H04N19/186 ,  H04N19/13 ,  H04N19/159 ,  H04N19/176 ,  H04N19/61

摘要： The present invention provides an entropy coding method for coding video prediction residual coefficients, comprising the steps of: firstly, zig-zag scanning coefficients of blocks to be coded to form a sequence of (level, run) pairs; secondly, selecting a type of code table for coding a current image block to be coded according to a type of macro block; then switching and coding each (level, run) pair in the obtained sequence of (level, run) pairs with multiple tables, with the reverse zig-zag scanning order for the coding order of the pairs; at last, coding a flag of End of Block EOB with the current code table. The present invention of an entropy coding method for coding video prediction residual coefficients fully considers the context information and the rules of symbol's conditional probability distribution by designing different tables for different block types and different regions of level. The coding efficiency is improved and no impact to computational implementation complexity is involved.

摘要翻译： 本发明提供了一种用于对视频预测残差系数进行编码的熵编码方法，包括以下步骤：首先，要编码的块的Z字形扫描系数形成（级，运行）对的序列; 其次，根据宏块的类型选择用于编码要编码的当前图像块的代码表类型; 然后在所获得的（多个表中）对的序列中对每个（电平，运行）对进行切换和编码，其中用于编码顺序的反向Z字形扫描顺序; 最后用当前代码表编码块EOB结束标志。 用于编码视频预测残差系数的熵编码方法的本发明通过为不同的块类型和不同的级别的区域设计不同的表格来充分地考虑上下文信息和符号的条件概率分布规则。 编码效率得到提高，对计算实现的复杂性没有影响。