公开(公告)号：US09525884B2

公开(公告)日：2016-12-20

申请号：US12978490

申请日：2010-12-24

申请人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shan Liu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shan Liu ,  Shaw-Min Lei

IPC分类号： H04N19/86 ,  H04N19/70 ,  H04N19/436 ,  H04N19/42 ,  H04N19/174 ,  H04N19/117 ,  H04N19/136 ,  H04N19/82 ,  H04N19/13 ,  H04N7/26 ,  H04N19/115 ,  H04N19/61

CPC分类号： H04N19/439 ,  H04N19/115 ,  H04N19/117 ,  H04N19/136 ,  H04N19/174 ,  H04N19/436 ,  H04N19/61 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： An apparatus and method for video coding having intra-slice deblocking, intra-slice adaptive loop filter, and intra-slice adaptive offset are disclosed. In a video coding system, a picture is often divided into slices and each slice is independently processed so that errors or missing data from one slice cannot propagate to any other slice within the picture. In the recent high efficiency video coding (HEVC) development, deblock filtering (DF), adaptive loop filter (ALF) and adaptive offset (AO) may be applied to reconstructed slices. When the processing is applied across slice boundaries, it may rely on pixels outside the current slice and cause dependency of the current slice on other slice(s). Consequently, the DF/ALF/AO processing on a reconstructed slice may have to wait until the reconstructed slices that it is dependent from complete the DF/ALF/AO processing. To overcome the slice boundary issue, intra-slice DF/ALF/AO is developed that does not rely on any pixel outside the currently slice. An optional slice boundary filter may be applied to slice boundaries after all slices are processed by the intra-slice DF/ALF/AO.

摘要翻译： 公开了一种具有片内解块，片内自适应环路滤波器和片内自适应偏移的视频编码的装置和方法。 在视频编码系统中，图像通常被分成片，并且每个片被独立地处理，使得来自一个片的错误或丢失的数据不能传播到图片内的任何其他片。 在最近的高效率视频编码（HEVC）开发中，解块滤波（DF），自适应环路滤波器（ALF）和自适应偏移（AO）可以应用于重构的片段。 当跨越切片边界应用处理时，它可以依赖于当前切片外部的像素，并且导致当前切片对其他切片的依赖。 因此，在重构的切片上的DF / ALF / AO处理可能必须等待直至重构的切片依赖于完成DF / ALF / AO处理。 为了克服切片边界问题，开发了片内DF / ALF / AO，其不依赖于当前切片之外的任何像素。 在片内DF / ALF / AO处理所有片段之后，可选择的片边界滤波器可应用于片边界。

公开(公告)号：US20120106624A1

公开(公告)日：2012-05-03

申请号：US12978490

申请日：2010-12-24

申请人： Yu-Wen Huang ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Chih-Wei Hsu ,  Shan Liu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Chih-Wei Hsu ,  Shan Liu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/439 ,  H04N19/115 ,  H04N19/117 ,  H04N19/136 ,  H04N19/174 ,  H04N19/436 ,  H04N19/61 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： An apparatus and method for video coding having intra-slice deblocking, intra-slice adaptive loop filter, and intra-slice adaptive offset are disclosed. In a video coding system, a picture is often divided into slices and each slice is independently processed so that errors or missing data from one slice cannot propagate to any other slice within the picture. In the recent high efficiency video coding (HEVC) development, deblock filtering (DF), adaptive loop filter (ALF) and adaptive offset (AO) may be applied to reconstructed slices. When the processing is applied across slice boundaries, it may rely on pixels outside the current slice and cause dependency of the current slice on other slice(s). Consequently, the DF/ALF/AO processing on a reconstructed slice may have to wait until the reconstructed slices that it is dependent from complete the DF/ALF/AO processing. To overcome the slice boundary issue, intra-slice DF/ALF/AO is developed that does not rely on any pixel outside the currently slice. An optional slice boundary filter may be applied to slice boundaries after all slices are processed by the intra-slice DF/ALF/AO.

摘要翻译： 公开了一种具有片内解块，片内自适应环路滤波器和片内自适应偏移的视频编码的装置和方法。 在视频编码系统中，图像通常被分成片，并且每个片被独立地处理，使得来自一个片的错误或丢失的数据不能传播到图片内的任何其他片。 在最近的高效率视频编码（HEVC）开发中，解块滤波（DF），自适应环路滤波器（ALF）和自适应偏移（AO）可以应用于重构的片段。 当跨越切片边界应用处理时，它可以依赖于当前切片外部的像素，并且导致当前切片对其他切片的依赖。 因此，在重构的切片上的DF / ALF / AO处理可能必须等待直至重构的切片依赖于完成DF / ALF / AO处理。 为了克服切片边界问题，开发了片内DF / ALF / AO，其不依赖于当前切片之外的任何像素。 在片内DF / ALF / AO处理所有片段之后，可选择的片边界滤波器可应用于片边界。

公开(公告)号：US20120114034A1

公开(公告)日：2012-05-10

申请号：US13018431

申请日：2011-02-01

申请人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Yu-Lin Chang ,  Tzu-Der Chuang ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Yu-Lin Chang ,  Tzu-Der Chuang ,  Shaw-Min Lei

IPC分类号： H04N7/12

CPC分类号： H04N19/174 ,  H04N19/103 ,  H04N19/119 ,  H04N19/126 ,  H04N19/13 ,  H04N19/146 ,  H04N19/159 ,  H04N19/176 ,  H04N19/18 ,  H04N19/463 ,  H04N19/70 ,  H04N19/96

摘要： In the current high efficiency video coding development, each LCU has its own quantization parameter (QP) and the difference between a current QP and a reference QP is transmitted instead of the QP value itself. Since the LCU is much larger than the macroblock of AVC/H.264, using one delta QP per LCU may cause rate control unable to adapt to the bitrate quickly enough. Consequently there is a need to adopt delta QP in units smaller than LCU to provide more granular rate control. Furthermore, it is desirable to develop a system that is capable of facilitating more flexible delta QP. Accordingly, adaptive quantization parameter processing is disclosed where a QP minimum CU size for incorporating or deriving a delta QP is indicated selectively in the slice level or in the sequence/picture level. In one variation, the delta QP is incorporated or derived only if nonzero quantized transform coefficients exist in a leaf CU that is larger than the QP minimum CU size. In another variation, quantization parameter information is only incorporated or derived when a leaf CU has any nonzero quantized transform coefficient. In yet another variation, a flag is used to indicate whether one delta QP per LCU is transmitted if the LCU has any nonzero quantized transform coefficient or one delta QP per leaf CU is transmitted if the leaf CU has any nonzero quantized transform coefficient.

摘要翻译： 在当前的高效率视频编码开发中，每个LCU具有其自己的量化参数（QP），并且发送当前QP与参考QP之间的差异而不是QP值本身。 由于LCU比AVC / H.264的宏块大得多，因此使用每个LCU的一个delta QP可能导致速率控制不能足够快地适应比特率。 因此，需要采用小于LCU的单位的delta QP来提供更细粒度的速率控制。 此外，期望开发能够促进更灵活的delta QP的系统。 因此，公开了自适应量化参数处理，其中用于合并或导出增量QP的QP最小CU尺寸在片级或序列/画面级别中有选择地表示。 在一个变型中，只有当非零量化变换系数存在于大于QP最小CU尺寸的叶CU中时，才加入或推导增量QP。 在另一个变型中，当叶CU具有任何非零量化变换系数时，仅结合或导出量化参数信息。 在又一个变型中，如果LCU具有任何非零量化变换系数，或者如果叶CU具有任何非零量化变换系数，则发送每个叶CU，则发送每个LCU一个ΔQP是否被发送的标志。

公开(公告)号：US20120106652A1

公开(公告)日：2012-05-03

申请号：US12966411

申请日：2010-12-13

申请人： Yu-Wen Huang ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Chih-Wei Hsu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Chih-Wei Hsu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/174 ,  H04N19/61 ,  H04N19/70

摘要： An apparatus and method for video coding based on flexible slice structure are disclosed. In the recent high efficiency video coding (HEVC) development, the slice may contain multiple LCUs instead of macroblocks. The LCU size being considered is 64×64 pixels which is much larger than the macroblock size of 16×16 pixels. Compared with the macroblock aligned slice for H.264, the LCU-aligned slice for HEVC does not provide enough granularities for dividing video frames. Consequently, a flexible slice structure is developed where slice partition is based on smaller coding units. In the flexible slice structure, the first LCU and the last LCU of the slice are allowed to be a fractional LCU, which is derived from a whole LCU using quadtree partition. Syntax elements are also developed to enable conveyance of flexible slice structure between an encoder and a decoder efficiently.

摘要翻译： 公开了一种基于柔性切片结构的视频编码的装置和方法。 在最近的高效率视频编码（HEVC）开发中，切片可以包含多个LCU而不是宏块。 所考虑的LCU尺寸是64×64像素，远大于16×16像素的宏块大小。 与H.264的宏块对准切片相比，HEVC的LCU对齐切片不能提供足够的粒度来分割视频帧。 因此，开发了一种灵活的切片结构，其中切片分区基于较小的编码单位。 在柔性切片结构中，切片的第一个LCU和最后一个LCU被允许为使用四叉树分区的整个LCU导出的分数LCU。 还开发了语法元件以有效地在编码器和解码器之间传送柔性片结构。

公开(公告)号：US09001883B2

公开(公告)日：2015-04-07

申请号：US13298294

申请日：2011-11-17

申请人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

IPC分类号： H04N7/50 ,  H04N19/86 ,  H04N19/70 ,  H04N19/172 ,  H04N19/117 ,  H04N19/174 ,  H04N7/26 ,  H04N19/82

CPC分类号： H04N19/117 ,  H04N19/136 ,  H04N19/172 ,  H04N19/174 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： A method and apparatus for sharing information in a video coding system are disclosed. Embodiments according to the present invention use an information sharing flag to determine whether to share in-loop filter information in the picture level. The information sharing flag may be incorporated in the sequence level, the picture level or the slice level to indicate whether information sharing is enabled. Multiple information sharing flags may also be used to adaptively control information sharing. Furthermore, method and apparatus of using multiple Adaptation Parameter Sets (APSs) for information sharing of in-loop filters are disclosed. APS identifiers of in-loop filters may be incorporated in the slice header to allow each of the in-loop filters select respective filter information from the multiple APSs. A flag is incorporated in SPS to indicate whether multiple APS or single APS is used. Various exemplary syntax designs are disclosed to illustrate information sharing.

摘要翻译： 公开了一种用于在视频编码系统中共享信息的方法和装置。 根据本发明的实施例使用信息共享标志来确定是否在图像级别中共享环路滤波器信息。 信息共享标志可以并入在序列级别，画面级或片级中，以指示是否启用信息共享。 也可以使用多个信息共享标志来自适应地控制信息共享。 此外，公开了使用多个适配参数集（APS）进行环路滤波器信息共享的方法和装置。 环路滤波器的APS标识符可以并入片标头中，以允许每个环路滤波器从多个APS中选择相应的滤波器信息。 SPS中包含一个标志，以指示是否使用多个APS或单个APS。 公开各种示例性语法设计来说明信息共享。

公开(公告)号：US20120106622A1

公开(公告)日：2012-05-03

申请号：US12984727

申请日：2011-01-05

申请人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/426 ,  H04N19/129 ,  H04N19/14 ,  H04N19/174

摘要： In the H.264/AVC standard, one of the new characteristics is the possibility of dividing an image in regions called slice groups. The use of slice groups provides various possible advantages such as prioritized transmission, error resilient transmission, and etc. The slice groups can be formed by flexible macroblock ordering (FMO), where each picture can be divided into slice groups in different scan patterns of the macroblocks. In the high efficiency video coding (HEVC) under development, a more flexible block structure, called coding unit (CU), is used as the unit to process video data. The picture is first divided into largest CUs (LCUs) and each LCU is adaptively split into smaller CUs using a quadtree until leaf CUs are reached. In the current HEVC development, there is neither slice nor slice group structure being considered. The LCU size used for HEVC is 16 times as large as the macroblock size used in the H.264/AVC standard. Therefore, it is very desirable to develop slice and slice group structure suited for HEVC to offer various benefits of error resilience, parallel processing, reduced line (row) buffer requirement, and etc. Accordingly, slice group types including raster scan type, vertical stripe type, regions of interest type and full flexibility type are developed for HEVC. Furthermore, various syntax elements are incorporated in the sequence header or the picture header to convey information associated with the slice group structure.

摘要翻译： 在H.264 / AVC标准中，新特性之一是在称为片组的区域中划分图像的可能性。 切片组的使用提供了各种可能的优点，例如优先传输，错误弹性传输等。切片组可以通过灵活的宏块排序（FMO）形成，其中每个图像可以被分成不同扫描模式的切片组 宏块。 在正在开发的高效率视频编码（HEVC）中，使用称为编码单元（CU）的更灵活的块结构作为处理视频数据的单元。 该图片首先划分为最大的CU（LCU），并且使用四叉树将每个LCU自适应地分割成较小的CU，直到达到叶CU。 在目前的HEVC开发中，既没有考虑切片也没有切片组结构。 用于HEVC的LCU大小是H.264 / AVC标准中使用的宏块尺寸的16倍。 因此，非常希望开发适用于HEVC的切片和切片组结构，以提供错误恢复，并行处理，减少线（行）缓冲器要求等各种优点。因此，包括光栅扫描类型，垂直条纹 类型，兴趣类型和全柔性类型为HEVC开发。 此外，各种语法元素被并入到序列头或图像头中以传送与切片组结构相关联的信息。

公开(公告)号：US08654860B2

公开(公告)日：2014-02-18

申请号：US12966411

申请日：2010-12-13

申请人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/174 ,  H04N19/61 ,  H04N19/70

摘要： An apparatus and method for video coding based on flexible slice structure are disclosed. In the recent high efficiency video coding (HEVC) development, the slice may contain multiple LCUs instead of macroblocks. The LCU size being considered is 64×64 pixels which is much larger than the macroblock size of 16×16 pixels. Compared with the macroblock aligned slice for H.264, the LCU-aligned slice for HEVC does not provide enough granularities for dividing video frames. Consequently, a flexible slice structure is developed where slice partition is based on smaller coding units. In the flexible slice structure, the first LCU and the last LCU of the slice are allowed to be a fractional LCU, which is derived from a whole LCU using quadtree partition. Syntax elements are also developed to enable conveyance of flexible slice structure between an encoder and a decoder efficiently.

摘要翻译： 公开了一种基于柔性切片结构的视频编码的装置和方法。 在最近的高效率视频编码（HEVC）开发中，切片可以包含多个LCU而不是宏块。 所考虑的LCU尺寸是64×64像素，远大于16×16像素的宏块大小。 与H.264的宏块排列片相比，HEVC的LCU对齐片不能提供足够的粒度来分割视频帧。 因此，开发了一种灵活的切片结构，其中切片分区基于较小的编码单位。 在柔性切片结构中，切片的第一个LCU和最后一个LCU被允许为使用四叉树分区的整个LCU导出的分数LCU。 还开发了语法元件以有效地在编码器和解码器之间传送柔性片结构。

公开(公告)号：US20130128986A1

公开(公告)日：2013-05-23

申请号：US13348488

申请日：2012-01-11

申请人： Chia-Yang Tsai ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/167 ,  H04N19/117 ,  H04N19/174 ,  H04N19/182 ,  H04N19/61 ,  H04N19/82

摘要： A method and apparatus for video processing of reconstructed video in a reconstruction loop are disclosed. An embodiment according to the present invention performs padding for the blocks in the slice boundaries according to a processing order. Each of the one or more reconstructed blocks at slice boundaries is padded according to a padding order. In-loop filtering is applied to the reconstructed slice according to the processing order, wherein the reconstructed slice is filtered by referencing the one or more padded blocks. The padding order can be vertical-edge first and then horizontal-edge, or horizontal-edge first and then vertical-edge. Various embodiments are disclosed regarding whether padding for a later padded block in the processing order is skipped or not in the overlapped area. The present invention is also applied to adaptation blocks for block-based in-loop filtering in slice boundaries.

摘要翻译： 公开了一种用于在重构环路中重构视频的视频处理的方法和装置。 根据本发明的实施例根据处理顺序对切片边界中的块执行填充。 根据填充顺序对切片边界处的一个或多个重构块中的每一个进行填充。 根据处理顺序对重构片段进行环路滤波，其中通过参考一个或多个填充块来过滤重建片段。 填充顺序可以先是垂直边缘，然后是水平边缘，或者先沿着水平边缘，然后是垂直边缘。 公开了关于在重叠区域中是否跳过处理顺序中的稍后填充块的填充的各种实施例。 本发明还应用于片边界中基于块的循环过滤的适配块。

公开(公告)号：US20120207227A1

公开(公告)日：2012-08-16

申请号：US13298294

申请日：2011-11-17

申请人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/117 ,  H04N19/136 ,  H04N19/172 ,  H04N19/174 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： A method and apparatus for sharing information in a video coding system are disclosed. Embodiments according to the present invention use an information sharing flag to determine whether to share in-loop filter information in the picture level. The information sharing flag may be incorporated in the sequence level, the picture level or the slice level to indicate whether information sharing is enabled. Multiple information sharing flags may also be used to adaptively control information sharing. Furthermore, method and apparatus of using multiple Adaptation Parameter Sets (APSs) for information sharing of in-loop filters are disclosed. APS identifiers of in-loop filters may be incorporated in the slice header to allow each of the in-loop filters select respective filter information from the multiple APSs. A flag is incorporated in SPS to indicate whether multiple APS or single APS is used. Various exemplary syntax designs are disclosed to illustrate information sharing.

摘要翻译： 公开了一种用于在视频编码系统中共享信息的方法和装置。 根据本发明的实施例使用信息共享标志来确定是否在图像级别中共享环路滤波器信息。 信息共享标志可以并入在序列级别，画面级或片级中，以指示是否启用信息共享。 也可以使用多个信息共享标志来自适应地控制信息共享。 此外，公开了使用多个适配参数集（APS）进行环路滤波器信息共享的方法和装置。 环路滤波器的APS标识符可以并入片标头中，以允许每个环路滤波器从多个APS中选择相应的滤波器信息。 SPS中包含一个标志，以指示是否使用多个APS或单个APS。 公开各种示例性语法设计来说明信息共享。

公开(公告)号：US09554128B2

公开(公告)日：2017-01-24

申请号：US14342334

申请日：2012-08-09

申请人： Chih-Wei Hsu ,  Qian Huang ,  Jicheng An ,  Xun Guo ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Wei Hsu ,  Qian Huang ,  Jicheng An ,  Xun Guo ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N19/117 ,  H04N19/50 ,  H04N19/176 ,  H04N19/14 ,  H04N19/186 ,  H04N19/82 ,  H04N19/86

CPC分类号： H04N19/117 ,  H04N19/14 ,  H04N19/176 ,  H04N19/186 ,  H04N19/50 ,  H04N19/82 ,  H04N19/86

摘要： A method and apparatus for deblocking of reconstructed video are disclosed. In one embodiment, the method divides a block boundary into two sub-boundaries and separates lines or column across the sub-boundaries into two groups. The deblocking filter decision for each group is determined based on the lines or columns in the respective group. In another embodiment, the method divides block edges of blocks in the LCUs into two edge groups, where the first edge group corresponds to horizontal block edges between two LCUs and the second edge group corresponds to remaining block edges not included in the first edge group. The number of lines processed by a vertical filter in the first edge group is less than the number of lines processed by a vertical filter in the second edge group. Accordingly, a system embodying the present invention has reduced storage requirement.

摘要翻译： 公开了一种重构视频解块的方法和装置。 在一个实施例中，该方法将块边界划分为两个子边界，并将跨越子边界的线或列分成两组。 基于相应组中的线或列确定每组的去块滤波器决定。 在另一个实施例中，该方法将LCU中的块的块边缘划分为两个边缘组，其中第一边缘组对应于两个LCU之间的水平块边缘，并且第二边缘组对应于未包括在第一边缘组中的剩余块边缘。 由第一边缘组中的垂直滤波器处理的线数小于由第二边缘组中的垂直滤波器处理的线数。 因此，体现本发明的系统减少了存储要求。