公开(公告)号：US20130215959A1

公开(公告)日：2013-08-22

申请号：US13825061

申请日：2011-12-31

申请人： Ching-Yeh Chen ,  Chih-Ming Fu ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Ching-Yeh Chen ,  Chih-Ming Fu ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/103 ,  H04N19/117 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82

摘要： Methods for filter-unit based in-loop filtering in a video decoder and encoder are disclosed. In one embodiment, filter parameters are selected from a filter parameter set for each filter based on a filter index. In another embodiment, the picture is partitioned into filter units according to filter unit size, which can be selected between a default size and other size. When other size is selected, the filter unit size may be conveyed using direct size information or ratio information. In another embodiment, a merge flag and a merge index are used to convey filter unit merge information. A method for filter-unit based in-loop filtering in a video encoder for color video is disclosed. In one embodiment, the method incorporates filter syntax in the video bitstream by interleaving the color-component filter syntax for the FUs.

摘要翻译： 公开了一种视频解码器和编码器中基于滤波器单元的环路滤波方法。 在一个实施例中，基于滤波器索引从针对每个滤波器的滤波器参数集中选择滤波器参数。 在另一个实施例中，根据滤波器单元尺寸将图像划分为滤波器单元，其可以在默认尺寸和其它尺寸之间进行选择。 当选择其他尺寸时，可以使用直接尺寸信息或比率信息来传送过滤器单元尺寸。 在另一个实施例中，使用合并标志和合并索引来传送过滤器单元合并信息。 公开了一种用于彩色视频的视频编码器中的基于滤波器单元的环路滤波的方法。 在一个实施例中，该方法通过交织FU的颜色分量滤波器语法来在视频比特流中包含滤波器语法。

公开(公告)号：US20110274158A1

公开(公告)日：2011-11-10

申请号：US13093068

申请日：2011-04-25

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Chia-Yang Tsai ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Chia-Yang Tsai ,  Shaw-Min Lei

IPC分类号： H04N11/02

CPC分类号： H04N19/117 ,  H04N19/10 ,  H04N19/115 ,  H04N19/129 ,  H04N19/134 ,  H04N19/137 ,  H04N19/14 ,  H04N19/154 ,  H04N19/157 ,  H04N19/159 ,  H04N19/174 ,  H04N19/176 ,  H04N19/186 ,  H04N19/196 ,  H04N19/439 ,  H04N19/463 ,  H04N19/82 ,  H04N19/86 ,  H04N19/96

摘要： In a block-based motion compensated system, coding noises may arise due to lossy operations such as quantization. Deblocking is often used to alleviate visibility of coding artifacts by applying filtering across block boundaries adaptively. In the recent HEVC development, adaptive loop filtering (ALF) is being adopted to process deblocked reconstruction frames. Adaptive loop filtering is applied to reconstructed video data across multiple frames to reduce visibility of coding artifacts in the temporal domain. In a HEVC system, conventional ALF can be selectively turned ON or OFF for each block in a frame or a slice. The advanced ALF disclosed here allows a choice of multiple filter sets that can be applied to the reconstructed video data adaptively. Furthermore, the advanced ALF adopts a new unit for the filtering process to apply so that more flexible and/or localized processing can be provided. Furthermore, the advanced ALF allows a decoder to derive respective information for applying the filtering process without side information.

摘要翻译： 在基于块的运动补偿系统中，由于诸如量化的有损操作，可能产生编码噪声。 解块通常用于通过自适应地跨越块边界应用过滤来减轻编码伪像的可视性。 在最近的HEVC开发中，正在采用自适应环路滤波（ALF）来处理解块重建帧。 自适应环路滤波被应用于跨多帧的重建视频数据，以减少时域中编码伪像的可见性。 在HEVC系统中，对于帧或片中的每个块，可以选择性地将常规ALF打开或关闭。 这里公开的高级ALF允许选择可以自适应地应用于重建的视频数据的多个滤波器组。 此外，先进的ALF采用新的过滤单元进行应用，从而可以提供更灵活和/或本地化的处理。 此外，高级ALF允许解码器导出用于应用无侧信息的过滤处理的相应信息。

公开(公告)号：US09877019B2

公开(公告)日：2018-01-23

申请号：US13825061

申请日：2011-12-31

申请人： Ching-Yeh Chen ,  Chih-Ming Fu ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Ching-Yeh Chen ,  Chih-Ming Fu ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N19/117 ,  H04N19/70 ,  H04N19/46 ,  H04N19/82

CPC分类号： H04N19/103 ,  H04N19/117 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82

摘要： Implementations of the invention are provided in methods for filter-unit based in-loop filtering in a video decoder and encoder. In one implementation, filter parameters are selected from a filter parameter set for each filter based on a filter index. In another implementation, the picture is partitioned into filter units according to filter unit size, which can be selected between a default size and other size. When other size is selected, the filter unit size may be conveyed using direct size information or ratio information. In another implementation, a merge flag and a merge index are used to convey filter unit merge information. A method for filter-unit based in-loop filtering in a video encoder for color video is disclosed. In one embodiment, the method incorporates filter syntax in the video bitstream by interleaving the color-component filter syntax for the FUs.

公开(公告)号：US09055305B2

公开(公告)日：2015-06-09

申请号：US13158427

申请日：2011-06-12

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N19/61 ,  H04N19/82 ,  H04N19/85

CPC分类号： H04N19/61 ,  H04N19/117 ,  H04N19/119 ,  H04N19/14 ,  H04N19/162 ,  H04N19/167 ,  H04N19/174 ,  H04N19/179 ,  H04N19/182 ,  H04N19/192 ,  H04N19/439 ,  H04N19/70 ,  H04N19/82 ,  H04N19/85 ,  H04N19/96

摘要： An apparatus and method for sample adaptive offset to restore intensity shift of processed video data are described. In a video coding system, the video data are subject to various processing such as prediction, transformation, quantization, deblocking, and adaptive loop filtering. Along the processing path in the video coding system, certain characteristics of the processed video data may be altered from the original video data due to the operations applied to video data. For example, the mean value of the processed video may be shifted. Therefore, the pixel intensity shift has to be carefully compensated or restored to alleviate the artifacts. Accordingly a sample adaptive offset scheme is disclosed that can take into consideration of the dynamic characteristics within a frame using a region partition scheme. Furthermore, the sample adaptive offset scheme also supports multiple SAO types that can be tailored to the characteristics of processed video data and achieve better quality.

摘要翻译： 描述了用于恢复处理的视频数据的强度偏移的采样自适应偏移的装置和方法。 在视频编码系统中，视频数据经历诸如预测，变换，量化，去块和自适应环路滤波的各种处理。 沿着视频编码系统中的处理路径，由于应用于视频数据的操作，处理的视频数据的某些特性可能会从原始视频数据中改变。 例如，处理的视频的平均值可能被移位。 因此，必须仔细地补偿或恢复像素强度偏移以减轻伪影。 因此，公开了可以使用区域分区方案考虑帧内的动态特性的样本自适应偏移方案。 此外，样本自适应偏移方案还支持多种SAO类型，可以根据处理的视频数据的特性进行调整，并实现更好的质量。

公开(公告)号：US08654860B2

公开(公告)日：2014-02-18

申请号：US12966411

申请日：2010-12-13

申请人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/174 ,  H04N19/61 ,  H04N19/70

摘要： An apparatus and method for video coding based on flexible slice structure are disclosed. In the recent high efficiency video coding (HEVC) development, the slice may contain multiple LCUs instead of macroblocks. The LCU size being considered is 64×64 pixels which is much larger than the macroblock size of 16×16 pixels. Compared with the macroblock aligned slice for H.264, the LCU-aligned slice for HEVC does not provide enough granularities for dividing video frames. Consequently, a flexible slice structure is developed where slice partition is based on smaller coding units. In the flexible slice structure, the first LCU and the last LCU of the slice are allowed to be a fractional LCU, which is derived from a whole LCU using quadtree partition. Syntax elements are also developed to enable conveyance of flexible slice structure between an encoder and a decoder efficiently.

摘要翻译： 公开了一种基于柔性切片结构的视频编码的装置和方法。 在最近的高效率视频编码（HEVC）开发中，切片可以包含多个LCU而不是宏块。 所考虑的LCU尺寸是64×64像素，远大于16×16像素的宏块大小。 与H.264的宏块排列片相比，HEVC的LCU对齐片不能提供足够的粒度来分割视频帧。 因此，开发了一种灵活的切片结构，其中切片分区基于较小的编码单位。 在柔性切片结构中，切片的第一个LCU和最后一个LCU被允许为使用四叉树分区的整个LCU导出的分数LCU。 还开发了语法元件以有效地在编码器和解码器之间传送柔性片结构。

公开(公告)号：US20130128986A1

公开(公告)日：2013-05-23

申请号：US13348488

申请日：2012-01-11

申请人： Chia-Yang Tsai ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/167 ,  H04N19/117 ,  H04N19/174 ,  H04N19/182 ,  H04N19/61 ,  H04N19/82

摘要： A method and apparatus for video processing of reconstructed video in a reconstruction loop are disclosed. An embodiment according to the present invention performs padding for the blocks in the slice boundaries according to a processing order. Each of the one or more reconstructed blocks at slice boundaries is padded according to a padding order. In-loop filtering is applied to the reconstructed slice according to the processing order, wherein the reconstructed slice is filtered by referencing the one or more padded blocks. The padding order can be vertical-edge first and then horizontal-edge, or horizontal-edge first and then vertical-edge. Various embodiments are disclosed regarding whether padding for a later padded block in the processing order is skipped or not in the overlapped area. The present invention is also applied to adaptation blocks for block-based in-loop filtering in slice boundaries.

摘要翻译： 公开了一种用于在重构环路中重构视频的视频处理的方法和装置。 根据本发明的实施例根据处理顺序对切片边界中的块执行填充。 根据填充顺序对切片边界处的一个或多个重构块中的每一个进行填充。 根据处理顺序对重构片段进行环路滤波，其中通过参考一个或多个填充块来过滤重建片段。 填充顺序可以先是垂直边缘，然后是水平边缘，或者先沿着水平边缘，然后是垂直边缘。 公开了关于在重叠区域中是否跳过处理顺序中的稍后填充块的填充的各种实施例。 本发明还应用于片边界中基于块的循环过滤的适配块。

公开(公告)号：US20120207227A1

公开(公告)日：2012-08-16

申请号：US13298294

申请日：2011-11-17

申请人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/117 ,  H04N19/136 ,  H04N19/172 ,  H04N19/174 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： A method and apparatus for sharing information in a video coding system are disclosed. Embodiments according to the present invention use an information sharing flag to determine whether to share in-loop filter information in the picture level. The information sharing flag may be incorporated in the sequence level, the picture level or the slice level to indicate whether information sharing is enabled. Multiple information sharing flags may also be used to adaptively control information sharing. Furthermore, method and apparatus of using multiple Adaptation Parameter Sets (APSs) for information sharing of in-loop filters are disclosed. APS identifiers of in-loop filters may be incorporated in the slice header to allow each of the in-loop filters select respective filter information from the multiple APSs. A flag is incorporated in SPS to indicate whether multiple APS or single APS is used. Various exemplary syntax designs are disclosed to illustrate information sharing.

摘要翻译： 公开了一种用于在视频编码系统中共享信息的方法和装置。 根据本发明的实施例使用信息共享标志来确定是否在图像级别中共享环路滤波器信息。 信息共享标志可以并入在序列级别，画面级或片级中，以指示是否启用信息共享。 也可以使用多个信息共享标志来自适应地控制信息共享。 此外，公开了使用多个适配参数集（APS）进行环路滤波器信息共享的方法和装置。 环路滤波器的APS标识符可以并入片标头中，以允许每个环路滤波器从多个APS中选择相应的滤波器信息。 SPS中包含一个标志，以指示是否使用多个APS或单个APS。 公开各种示例性语法设计来说明信息共享。

公开(公告)号：US20120177107A1

公开(公告)日：2012-07-12

申请号：US13158427

申请日：2011-06-12

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N7/40

CPC分类号： H04N19/61 ,  H04N19/117 ,  H04N19/119 ,  H04N19/14 ,  H04N19/162 ,  H04N19/167 ,  H04N19/174 ,  H04N19/179 ,  H04N19/182 ,  H04N19/192 ,  H04N19/439 ,  H04N19/70 ,  H04N19/82 ,  H04N19/85 ,  H04N19/96

摘要： An apparatus and method for sample adaptive offset to restore intensity shift of processed video data are described. In a video coding system, the video data are subject to various processing such as prediction, transformation, quantization, deblocking, and adaptive loop filtering. Along the processing path in the video coding system, certain characteristics of the processed video data may be altered from the original video data due to the operations applied to video data. For example, the mean value of the processed video may be shifted. Therefore, the pixel intensity shift has to be carefully compensated or restored to alleviate the artifacts. Accordingly a sample adaptive offset scheme is disclosed that can take into consideration of the dynamic characteristics within a frame using a region partition scheme. Furthermore, the sample adaptive offset scheme also supports multiple SAO types that can be tailored to the characteristics of processed video data and achieve better quality.

摘要翻译： 描述了用于恢复处理的视频数据的强度偏移的采样自适应偏移的装置和方法。 在视频编码系统中，视频数据经历诸如预测，变换，量化，去块和自适应环路滤波的各种处理。 沿着视频编码系统中的处理路径，由于应用于视频数据的操作，处理的视频数据的某些特性可能会从原始视频数据中改变。 例如，处理的视频的平均值可能被移位。 因此，必须仔细地补偿或恢复像素强度偏移以减轻伪影。 因此，公开了可以使用区域分区方案考虑帧内的动态特性的样本自适应偏移方案。 此外，样本自适应偏移方案还支持多种SAO类型，可以根据处理的视频数据的特性进行调整，并实现更好的质量。

公开(公告)号：US20120177103A1

公开(公告)日：2012-07-12

申请号：US13177424

申请日：2011-07-06

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/117 ,  H04N19/136 ,  H04N19/14 ,  H04N19/147 ,  H04N19/176 ,  H04N19/182 ,  H04N19/61 ,  H04N19/82 ,  H04N19/85 ,  H04N19/86

摘要： For sample adaptive offset, classification may be used to classify the pixels into multiple categories and pixels in each category are offset compensated using an offset value for the category. The classification may be based on values of the current pixel and its neighboring pixels before SAO compensation. Therefore, the SAO compensated pixel cannot be written back to the current pixel location until the category for all pixels are determined. An embodiment of the present invention stores the relation between the current pixel and said one or more neighboring pixels so that the SAO compensated current pixel can replace the current pixel without buffering the to-be-processed pixels for classification. The SAO process may be performed on a region by region basis to adapt to the local characteristics of the picture. Rate-distortion optimization (RDO) is often used to guide the mode decision, such as region splitting/region merging decision. Computations associated with the RDO process usually are very computational intensive. Accordingly, distortion reduction estimation is developed which can substantially reduce the required computation associated with RDO.

摘要翻译： 对于样本自适应偏移，可以使用分类来将像素分类为多个类别，并且使用该类别的偏移值来对每个类别中的像素进行偏移补偿。 分类可以基于SAO补偿之前的当前像素及其相邻像素的值。 因此，在确定所有像素的类别之前，SAO补偿像素不能被写回到当前像素位置。 本发明的实施例存储当前像素和所述一个或多个相邻像素之间的关系，使得SAO补偿的当前像素可以代替当前像素，而不缓冲待处理像素用于分类。 可以在逐个区域的基础上执行SAO处理，以适应图像的局部特征。 速率失真优化（RDO）经常用于指导模式决策，如区域分割/区域合并决策。 与RDO过程相关的计算通常是非常计算密集型的。 因此，开发了可以显着减少与RDO相关联的所需计算的失真减小估计。

公开(公告)号：US20120082241A1

公开(公告)日：2012-04-05

申请号：US13216242

申请日：2011-08-24

申请人： Chia-Yang Tsai ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/82 ,  H04N19/117 ,  H04N19/119 ,  H04N19/147 ,  H04N19/17 ,  H04N19/176 ,  H04N19/182 ,  H04N19/439 ,  H04N19/80

摘要： A method and apparatus for processing in-loop reconstructed video using an in-loop filter is disclosed. In the recent HEVC development, adaptive loop filtering (ALF) is being adopted to process in-loop reconstruction video data, where ALF can be selectively turned ON or OFF for each block in a frame or a slice. An advanced ALF is disclosed later that allows a choice of multiple filter sets that can be applied to the reconstructed video data adaptively. In the present disclosure, pixels of the in-loop reconstructed video data are divided into a plurality of to-be-filtered regions, and an in-loop filter from a filter set is determined for each to-be-filtered region based on a rate-distortion optimization procedure. According to one embodiment of the present invention, computation of cost function associated with the rate-distortion optimization procedure is related to correlation values associated with original video data and the in-loop reconstructed video data. Furthermore, the correlation values can be shared by the multiple candidate filters during the rate-distortion optimization procedure for said each to-be-filtered region. In another embodiment, the correlation values can be shared by multiple candidate to-be-filtered regions of an area of the in-loop reconstructed video data during the rate-distortion optimization procedure for the area of the in-loop reconstructed video data.

摘要翻译： 公开了一种使用环路滤波器来处理环路重建视频的方法和装置。 在最近的HEVC开发中，正在采用自适应环路滤波（ALF）来处理环路重建视频数据，其中ALF可以针对帧或片中的每个块选择性地打开或关闭。 稍后公开了一种先进的ALF，其允许选择可以自适应地应用于重建的视频数据的多个滤波器组。 在本公开中，环路内重建的视频数据的像素被划分成多个要被滤波的区域，并且基于一个滤波器组确定针对每个被过滤区域的滤波器组的环路滤波器 速率失真优化程序。 根据本发明的一个实施例，与速率失真优化过程相关联的成本函数的计算与与原始视频数据和环路内重建视频数据相关联的相关值相关。 此外，在针对所述每个待被过滤的区域的速率失真优化过程期间，相关值可由多个候选滤波器共享。 在另一个实施例中，相关值可以在针对环路内重建的视频数据的区域的速率失真优化过程期间由循环内重构视频数据的区域的多个候选被被滤波区域共享。