公开(公告)号：US08457430B2

公开(公告)日：2013-06-04

申请号：US12534154

申请日：2009-08-02

申请人： Yu-Pao Tsai ,  Yu-Wen Huang ,  Ying-Jui Chen ,  Shaw-Min Lei

发明人： Yu-Pao Tsai ,  Yu-Wen Huang ,  Ying-Jui Chen ,  Shaw-Min Lei

IPC分类号： G06K9/40

CPC分类号： G06T5/002 ,  G06T5/20 ,  G06T2207/20012

摘要： A region-based method for iterative regularization image enhancement, includes: for each region of a plurality of regions of an image, performing at least one gradient calculation of an objective function of a latest representative function of the region and updating the latest representative function according to the gradient calculation; and for the region of the plurality of regions of the image, when at least one predetermined convergence criterion is not satisfied, iteratively updating the latest representative function according to at least one gradient calculation of the same objective function of the latest representative function. In particular, the region-based method further includes: for the region of the plurality of regions of the image, when the predetermined convergence criterion is satisfied, performing postprocessing on the latest representative function of the region to generate an iteratively regularized partial image corresponding to the region. An associated region-based apparatus and processing circuit are further provided.

摘要翻译： 一种用于迭代正则化图像增强的基于区域的方法包括：对于图像的多个区域中的每个区域，执行所述区域的最新代表性函数的目标函数的至少一个梯度计算，并且根据 到梯度计算; 并且对于图像的多个区域的区域，当不满足至少一个预定收敛标准时，根据最新代表函数的相同目标函数的至少一个梯度计算迭代地更新最新代表函数。 特别地，基于区域的方法还包括：对于图像的多个区域的区域，当满足预定的收敛标准时，对该区域的最新的代表性函数执行后处理，以生成对应于 该区域。 还提供了一种基于区域的设备和处理电路。

公开(公告)号：US20130128986A1

公开(公告)日：2013-05-23

申请号：US13348488

申请日：2012-01-11

申请人： Chia-Yang Tsai ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/167 ,  H04N19/117 ,  H04N19/174 ,  H04N19/182 ,  H04N19/61 ,  H04N19/82

摘要： A method and apparatus for video processing of reconstructed video in a reconstruction loop are disclosed. An embodiment according to the present invention performs padding for the blocks in the slice boundaries according to a processing order. Each of the one or more reconstructed blocks at slice boundaries is padded according to a padding order. In-loop filtering is applied to the reconstructed slice according to the processing order, wherein the reconstructed slice is filtered by referencing the one or more padded blocks. The padding order can be vertical-edge first and then horizontal-edge, or horizontal-edge first and then vertical-edge. Various embodiments are disclosed regarding whether padding for a later padded block in the processing order is skipped or not in the overlapped area. The present invention is also applied to adaptation blocks for block-based in-loop filtering in slice boundaries.

摘要翻译： 公开了一种用于在重构环路中重构视频的视频处理的方法和装置。 根据本发明的实施例根据处理顺序对切片边界中的块执行填充。 根据填充顺序对切片边界处的一个或多个重构块中的每一个进行填充。 根据处理顺序对重构片段进行环路滤波，其中通过参考一个或多个填充块来过滤重建片段。 填充顺序可以先是垂直边缘，然后是水平边缘，或者先沿着水平边缘，然后是垂直边缘。 公开了关于在重叠区域中是否跳过处理顺序中的稍后填充块的填充的各种实施例。 本发明还应用于片边界中基于块的循环过滤的适配块。

公开(公告)号：US08325801B2

公开(公告)日：2012-12-04

申请号：US12192147

申请日：2008-08-15

申请人： Shaw-Min Lei ,  Yu-Wen Huang

发明人： Shaw-Min Lei ,  Yu-Wen Huang

IPC分类号： H04N7/12

CPC分类号： H04N19/00139 ,  H04N19/117 ,  H04N19/136 ,  H04N19/147 ,  H04N19/172 ,  H04N19/46 ,  H04N19/61 ,  H04N19/82

摘要： A coding system includes an inter prediction block, a transform and quantization block, an encoding unit, and a reconstruction loop with an adaptive restoration block. The inter prediction block performs prediction on a current frame, the transform and quantization block performs transform and quantization processes on prediction residues, and the reconstruction loop reconstructs the current frame to generate the restored reconstructed samples. The adaptive restoration block performs restoration on processed data by considering a plurality of candidate restoration methods, selects one of the candidate restoration methods as a final restoration method, and generates adaptive restoration information corresponding to the final restoration method. The encoding unit encodes the prediction information and adaptive restoration information to generate an encoded bitstream.

摘要翻译： 编码系统包括帧间预测块，变换和量化块，编码单元和具有自适应恢复块的重建循环。 帧间预测块对当前帧执行预测，变换和量化块对预测残差执行变换和量化处理，并且重建循环重建当前帧以生成恢复的重建样本。 自适应恢复块通过考虑多个候选恢复方法来执行对处理数据的恢复，选择候选恢复方法之一作为最终恢复方法，并且生成与最终恢复方法对应的自适应恢复信息。 编码单元对预测信息和自适应恢复信息进行编码，以生成编码比特流。

公开(公告)号：US20120207227A1

公开(公告)日：2012-08-16

申请号：US13298294

申请日：2011-11-17

申请人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/117 ,  H04N19/136 ,  H04N19/172 ,  H04N19/174 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： A method and apparatus for sharing information in a video coding system are disclosed. Embodiments according to the present invention use an information sharing flag to determine whether to share in-loop filter information in the picture level. The information sharing flag may be incorporated in the sequence level, the picture level or the slice level to indicate whether information sharing is enabled. Multiple information sharing flags may also be used to adaptively control information sharing. Furthermore, method and apparatus of using multiple Adaptation Parameter Sets (APSs) for information sharing of in-loop filters are disclosed. APS identifiers of in-loop filters may be incorporated in the slice header to allow each of the in-loop filters select respective filter information from the multiple APSs. A flag is incorporated in SPS to indicate whether multiple APS or single APS is used. Various exemplary syntax designs are disclosed to illustrate information sharing.

摘要翻译： 公开了一种用于在视频编码系统中共享信息的方法和装置。 根据本发明的实施例使用信息共享标志来确定是否在图像级别中共享环路滤波器信息。 信息共享标志可以并入在序列级别，画面级或片级中，以指示是否启用信息共享。 也可以使用多个信息共享标志来自适应地控制信息共享。 此外，公开了使用多个适配参数集（APS）进行环路滤波器信息共享的方法和装置。 环路滤波器的APS标识符可以并入片标头中，以允许每个环路滤波器从多个APS中选择相应的滤波器信息。 SPS中包含一个标志，以指示是否使用多个APS或单个APS。 公开各种示例性语法设计来说明信息共享。

公开(公告)号：US20120177113A1

公开(公告)日：2012-07-12

申请号：US13198697

申请日：2011-08-04

申请人： Mei Guo ,  Xun Guo ,  Shaw-Min Lei

发明人： Mei Guo ,  Xun Guo ,  Shaw-Min Lei

IPC分类号： H04N7/32

CPC分类号： H04N19/593 ,  H04N19/11 ,  H04N19/159 ,  H04N19/196 ,  H04N19/463

摘要： A method and apparatus for improved intra prediction mode coding are disclosed. Intra prediction exploits the spatial correlation within a picture or within a picture region. In practice, a picture is divided into blocks and the intra mode prediction is performed on a block basis. In newer coding systems, multiple intra prediction modes such as Vertical mode, Horizontal mode, DC mode and Diagonal mode, have been used to improve the coding efficiency of intra coding. However, the mode selection information for intra prediction has to be conveyed to the decoder for proper operation. In High-Efficiency Video Coding (HEVC), a coding scheme for the intra luma prediction mode is being considered, where the intra prediction mode of a current block is compared with the minimum of two intra luma prediction modes corresponding to two neighboring blocks. If the intra prediction mode of the current block is the same as the minimum of the two neighboring intra luma prediction modes, a single bit is transmitted to indicate the case. Otherwise, information for the current intra prediction mode is transmitted in fixed-length codeword. While the coding scheme for the intra luma prediction mode being considered may not fully exploit the neighboring intra luma prediction modes, it is desirable to further improve the performance. Accordingly, an improved coding scheme for intra prediction mode is disclosed, where more than one intra prediction mode candidates are derived.

摘要翻译： 公开了一种用于改进帧内预测模式编码的方法和装置。 帧内预测利用图片内或图片区域内的空间相关性。 实际上，将图像划分成块，并且以块为基础执行帧内模式预测。 在较新的编码系统中，已经使用诸如垂直模式，水平模式，直流模式和对角线模式的多个帧内预测模式来提高帧内编码的编码效率。 然而，用于帧内预测的模式选择信息必须被传送到解码器以进行正确的操作。 在高效率视频编码（HEVC）中，正在考虑用于内部亮度预测模式的编码方案，其中将当前块的帧内预测模式与对应于两个相邻块的两个内部亮度预测模式的最小值进行比较。 如果当前块的帧内预测模式与两个相邻帧内亮度预测模式的最小值相同，则发送单个位以指示该情况。 否则，以固定长度的码字发送当前帧内预测模式的信息。 虽然正在考虑的内部亮度预测模式的编码方案可能不能充分利用相邻的内部亮度预测模式，但是期望进一步提高性能。 因此，公开了一种用于帧内预测模式的改进编码方案，其中导出多于一个帧内预测模式候选。

公开(公告)号：US20120177107A1

公开(公告)日：2012-07-12

申请号：US13158427

申请日：2011-06-12

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N7/40

CPC分类号： H04N19/61 ,  H04N19/117 ,  H04N19/119 ,  H04N19/14 ,  H04N19/162 ,  H04N19/167 ,  H04N19/174 ,  H04N19/179 ,  H04N19/182 ,  H04N19/192 ,  H04N19/439 ,  H04N19/70 ,  H04N19/82 ,  H04N19/85 ,  H04N19/96

摘要： An apparatus and method for sample adaptive offset to restore intensity shift of processed video data are described. In a video coding system, the video data are subject to various processing such as prediction, transformation, quantization, deblocking, and adaptive loop filtering. Along the processing path in the video coding system, certain characteristics of the processed video data may be altered from the original video data due to the operations applied to video data. For example, the mean value of the processed video may be shifted. Therefore, the pixel intensity shift has to be carefully compensated or restored to alleviate the artifacts. Accordingly a sample adaptive offset scheme is disclosed that can take into consideration of the dynamic characteristics within a frame using a region partition scheme. Furthermore, the sample adaptive offset scheme also supports multiple SAO types that can be tailored to the characteristics of processed video data and achieve better quality.

摘要翻译： 描述了用于恢复处理的视频数据的强度偏移的采样自适应偏移的装置和方法。 在视频编码系统中，视频数据经历诸如预测，变换，量化，去块和自适应环路滤波的各种处理。 沿着视频编码系统中的处理路径，由于应用于视频数据的操作，处理的视频数据的某些特性可能会从原始视频数据中改变。 例如，处理的视频的平均值可能被移位。 因此，必须仔细地补偿或恢复像素强度偏移以减轻伪影。 因此，公开了可以使用区域分区方案考虑帧内的动态特性的样本自适应偏移方案。 此外，样本自适应偏移方案还支持多种SAO类型，可以根据处理的视频数据的特性进行调整，并实现更好的质量。

公开(公告)号：US20120177103A1

公开(公告)日：2012-07-12

申请号：US13177424

申请日：2011-07-06

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/117 ,  H04N19/136 ,  H04N19/14 ,  H04N19/147 ,  H04N19/176 ,  H04N19/182 ,  H04N19/61 ,  H04N19/82 ,  H04N19/85 ,  H04N19/86

摘要： For sample adaptive offset, classification may be used to classify the pixels into multiple categories and pixels in each category are offset compensated using an offset value for the category. The classification may be based on values of the current pixel and its neighboring pixels before SAO compensation. Therefore, the SAO compensated pixel cannot be written back to the current pixel location until the category for all pixels are determined. An embodiment of the present invention stores the relation between the current pixel and said one or more neighboring pixels so that the SAO compensated current pixel can replace the current pixel without buffering the to-be-processed pixels for classification. The SAO process may be performed on a region by region basis to adapt to the local characteristics of the picture. Rate-distortion optimization (RDO) is often used to guide the mode decision, such as region splitting/region merging decision. Computations associated with the RDO process usually are very computational intensive. Accordingly, distortion reduction estimation is developed which can substantially reduce the required computation associated with RDO.

摘要翻译： 对于样本自适应偏移，可以使用分类来将像素分类为多个类别，并且使用该类别的偏移值来对每个类别中的像素进行偏移补偿。 分类可以基于SAO补偿之前的当前像素及其相邻像素的值。 因此，在确定所有像素的类别之前，SAO补偿像素不能被写回到当前像素位置。 本发明的实施例存储当前像素和所述一个或多个相邻像素之间的关系，使得SAO补偿的当前像素可以代替当前像素，而不缓冲待处理像素用于分类。 可以在逐个区域的基础上执行SAO处理，以适应图像的局部特征。 速率失真优化（RDO）经常用于指导模式决策，如区域分割/区域合并决策。 与RDO过程相关的计算通常是非常计算密集型的。 因此，开发了可以显着减少与RDO相关联的所需计算的失真减小估计。

公开(公告)号：US20120134416A1

公开(公告)日：2012-05-31

申请号：US13206891

申请日：2011-08-10

申请人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/52

摘要： A method and apparatus for deriving a temporal motion vector predictor (MVP) are disclosed. The MVP is derived for a current block of a current picture in Inter, or Merge, or Skip mode based on co-located reference blocks of a co-located block. The co-located reference blocks comprise an above-left reference block of the bottom-right neighboring block of the co-located block. The reference motion vectors associated with the co-located reference blocks are received and used to derive the temporal MVP. Various configurations of co-located reference blocks can be used to practice the present invention. If the MVP cannot be found based on the above-left reference block, search for the MVP can be continued based on other co-located reference blocks. When an MVP is found, the MVP is checked against the previously found MVP. If the MVP is the same as the previously found MVP, the search for MVP continues.

摘要翻译： 公开了用于导出时间运动矢量预测器（MVP）的方法和装置。 基于同位置块的同位置参考块，针对Inter或当前图像的当前块导出MVP，或合并或跳跃模式。 共同定位的参考块包括同位置块的右下相邻块的左上参考块。 与同位置参考块相关联的参考运动矢量被接收并用于导出时间MVP。 可以使用共同定位的参考块的各种配置来实施本发明。 如果基于上述左参考块不能找到MVP，则可以基于其他同位置参考块继续搜索MVP。 当找到MVP时，将针对先前发现的MVP检查MVP。 如果MVP与以前发现的MVP相同，则继续搜索MVP。

公开(公告)号：US20120082241A1

公开(公告)日：2012-04-05

申请号：US13216242

申请日：2011-08-24

申请人： Chia-Yang Tsai ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/82 ,  H04N19/117 ,  H04N19/119 ,  H04N19/147 ,  H04N19/17 ,  H04N19/176 ,  H04N19/182 ,  H04N19/439 ,  H04N19/80

摘要： A method and apparatus for processing in-loop reconstructed video using an in-loop filter is disclosed. In the recent HEVC development, adaptive loop filtering (ALF) is being adopted to process in-loop reconstruction video data, where ALF can be selectively turned ON or OFF for each block in a frame or a slice. An advanced ALF is disclosed later that allows a choice of multiple filter sets that can be applied to the reconstructed video data adaptively. In the present disclosure, pixels of the in-loop reconstructed video data are divided into a plurality of to-be-filtered regions, and an in-loop filter from a filter set is determined for each to-be-filtered region based on a rate-distortion optimization procedure. According to one embodiment of the present invention, computation of cost function associated with the rate-distortion optimization procedure is related to correlation values associated with original video data and the in-loop reconstructed video data. Furthermore, the correlation values can be shared by the multiple candidate filters during the rate-distortion optimization procedure for said each to-be-filtered region. In another embodiment, the correlation values can be shared by multiple candidate to-be-filtered regions of an area of the in-loop reconstructed video data during the rate-distortion optimization procedure for the area of the in-loop reconstructed video data.

摘要翻译： 公开了一种使用环路滤波器来处理环路重建视频的方法和装置。 在最近的HEVC开发中，正在采用自适应环路滤波（ALF）来处理环路重建视频数据，其中ALF可以针对帧或片中的每个块选择性地打开或关闭。 稍后公开了一种先进的ALF，其允许选择可以自适应地应用于重建的视频数据的多个滤波器组。 在本公开中，环路内重建的视频数据的像素被划分成多个要被滤波的区域，并且基于一个滤波器组确定针对每个被过滤区域的滤波器组的环路滤波器 速率失真优化程序。 根据本发明的一个实施例，与速率失真优化过程相关联的成本函数的计算与与原始视频数据和环路内重建视频数据相关联的相关值相关。 此外，在针对所述每个待被过滤的区域的速率失真优化过程期间，相关值可由多个候选滤波器共享。 在另一个实施例中，相关值可以在针对环路内重建的视频数据的区域的速率失真优化过程期间由循环内重构视频数据的区域的多个候选被被滤波区域共享。

公开(公告)号：US20120027097A1

公开(公告)日：2012-02-02

申请号：US13270249

申请日：2011-10-11

申请人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Shaw-Min Lei

IPC分类号： H04N7/32

CPC分类号： H04N19/139 ,  H04N19/513 ,  H04N19/52 ,  H04N19/56

摘要： A method for performing localized multihypothesis prediction during video coding of a coding unit includes processing the coding unit. More particularly, the step of processing the coding unit further includes: obtaining at least two sets of motion information derived from a set of coded units for multihypothesis motion compensation of the coding unit; and utilizing a linear combination of a plurality of pixel values derived from the at least two sets of motion information derived from the set of coded units as a predicted pixel value of the coding unit. An associated apparatus is also provided.

摘要翻译： 一种用于在编码单元的视频编码期间执行局部多假设预测的方法包括处理编码单元。 更具体地，处理编码单元的步骤还包括：从编码单元的多个假设运动补偿的一组编码单元中获取至少两组运动信息; 并且利用从所述编码单元组导出的所述至少两组运动信息导出的多个像素值的线性组合作为所述编码单元的预测像素值。 还提供了一种相关联的装置。