公开(公告)号：US09049452B2

公开(公告)日：2015-06-02

申请号：US13272221

申请日：2011-10-13

申请人： Shan Liu ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Shan Liu ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04B1/66 ,  H04N19/463 ,  H04N19/176 ,  H04N19/119 ,  H04N19/147 ,  H04N19/96 ,  H04N7/26 ,  H04N19/159

CPC分类号： H04N19/51 ,  H04N19/119 ,  H04N19/13 ,  H04N19/147 ,  H04N19/157 ,  H04N19/159 ,  H04N19/176 ,  H04N19/44 ,  H04N19/46 ,  H04N19/463 ,  H04N19/647 ,  H04N19/91 ,  H04N19/96

摘要： In HEVC (High Efficiency Video Coding), a 2N×2N coding unit can be partitioned into various partition types hierarchically. The coding system uses a criterion to determine the best partition, where RD-rate is often used as the criterion. N×N partition at level k becomes redundant if 2N×2N at level k+1 will be evaluated. In order to eliminate the above redundancy, the allowable partition sizes are constrained according to a method previously disclosed. In the current invention, the complexity is further reduced. According to one embodiment, N×N partition is not allowed for any INTER mode regardless of the coding unit size. Furthermore, flexibility is provided so that either the method and apparatus with further complexity reduction can be selected or an alternative method and apparatus can be selected. Syntaxes to support embodiments according to the present invention are also disclosed.

摘要翻译： 在HEVC（高效率视频编码）中，2N×2N个编码单元可以分层划分成各种分区类型。 编码系统使用标准来确定最佳分区，其中通常使用RD率作为标准。 如果在级别k + 1处的2N×2N将被评估，则级别k的N×N分区变得冗余。 为了消除上述冗余，根据先前公开的方法来限制允许的分区大小。 在本发明中，复杂性进一步降低。 根据一个实施例，无论编码单元大小如何，对于任何INTER模式，不允许N×N分区。 此外，提供灵活性，使得可以选择具有进一步复杂度降低的方法和装置，或者可以选择替代方法和装置。 还公开了用于支持根据本发明的实施例的语法。

公开(公告)号：US09001883B2

公开(公告)日：2015-04-07

申请号：US13298294

申请日：2011-11-17

申请人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Wei Hsu ,  Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Shaw-Min Lei

IPC分类号： H04N7/50 ,  H04N19/86 ,  H04N19/70 ,  H04N19/172 ,  H04N19/117 ,  H04N19/174 ,  H04N7/26 ,  H04N19/82

CPC分类号： H04N19/117 ,  H04N19/136 ,  H04N19/172 ,  H04N19/174 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： A method and apparatus for sharing information in a video coding system are disclosed. Embodiments according to the present invention use an information sharing flag to determine whether to share in-loop filter information in the picture level. The information sharing flag may be incorporated in the sequence level, the picture level or the slice level to indicate whether information sharing is enabled. Multiple information sharing flags may also be used to adaptively control information sharing. Furthermore, method and apparatus of using multiple Adaptation Parameter Sets (APSs) for information sharing of in-loop filters are disclosed. APS identifiers of in-loop filters may be incorporated in the slice header to allow each of the in-loop filters select respective filter information from the multiple APSs. A flag is incorporated in SPS to indicate whether multiple APS or single APS is used. Various exemplary syntax designs are disclosed to illustrate information sharing.

摘要翻译： 公开了一种用于在视频编码系统中共享信息的方法和装置。 根据本发明的实施例使用信息共享标志来确定是否在图像级别中共享环路滤波器信息。 信息共享标志可以并入在序列级别，画面级或片级中，以指示是否启用信息共享。 也可以使用多个信息共享标志来自适应地控制信息共享。 此外，公开了使用多个适配参数集（APS）进行环路滤波器信息共享的方法和装置。 环路滤波器的APS标识符可以并入片标头中，以允许每个环路滤波器从多个APS中选择相应的滤波器信息。 SPS中包含一个标志，以指示是否使用多个APS或单个APS。 公开各种示例性语法设计来说明信息共享。

公开(公告)号：US08755437B2

公开(公告)日：2014-06-17

申请号：US13177808

申请日：2011-07-07

申请人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/28

CPC分类号： H04N19/513 ,  H04N19/52

摘要： An apparatus and method for deriving a motion vector predictor are disclosed. In video coding systems, the spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the information to be transmitted or stored. Motion vector prediction has been used to further conserve the bitrate associated with motion vector coding. In a conventional coding system, a motion vector predictor (MVP) is selected from the spatial MVPs and temporal MVP. The spatial MVP according to a conventional approach is based on motion vectors (MVs) of neighboring blocking pointing to a target reference picture in a given reference list. Embodiments according to the present invention perform the MVP search among an extended search set including MVs pointing to other reference pictures in the given reference list or the other reference list and MVs pointing to the target reference picture in the given reference list or the other reference list. Other aspects of the present invention address the search order of the search set and configuration of neighboring blocks.

摘要翻译： 公开了一种用于导出运动矢量预测器的装置和方法。 在视频编码系统中，使用空间和时间预测来利用空间和时间冗余来减少要发送或存储的信息。 运动矢量预测已被用于进一步节省与运动矢量编码相关的比特率。 在常规编码系统中，从空间MVP和时间MVP中选择运动矢量预测器（MVP）。 根据常规方法的空间MVP基于指向给定参考列表中的目标参考图片的相邻块的运动矢量（MV）。 根据本发明的实施例在包括指定给定参考列表中的其他参考图片的MV的扩展搜索集或另一参考列表中的MVP搜索和指向给定参考列表或另一参考列表中的目标参考图片的MV 。 本发明的其它方面解决了搜索集的搜索顺序和相邻块的配置。

公开(公告)号：US20120294353A1

公开(公告)日：2012-11-22

申请号：US13311953

申请日：2011-12-06

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/12

CPC分类号： H04N19/82 ,  H04N19/117 ,  H04N19/132 ,  H04N19/157 ,  H04N19/176 ,  H04N19/186 ,  H04N19/196 ,  H04N19/463 ,  H04N19/70 ,  H04N19/96

摘要： A method and apparatus for processing reconstructed video using in-loop filter in a video coding system are disclosed. The method uses chroma in-loop filter indication to indicate whether chroma components are processed by in-loop filter when the luma in-loop filter indication indicates that in-loop filter processing is applied to the luma component. An additional flag may be used to indicate whether the in-loop filter processing is applied to an entire picture using same in-loop filter information or each block of the picture using individual in-loop filter information. Various embodiments according to the present invention to increase efficiency are disclosed, wherein various aspects of in-loop filter information are taken into consideration for efficient coding such as the property of quadtree-based partition, boundary conditions of a block, in-loop filter information sharing between luma and chroma components, indexing to a set of in-loop filter information, and prediction of in-loop filter information.

摘要翻译： 公开了一种使用视频编码系统中的环路滤波器处理重构视频的方法和装置。 该方法使用色度环路滤波器指示来指示当亮度环路滤波器指示表明将环路滤波处理应用于亮度分量时，是否通过环路滤波器处理色度分量。 可以使用附加标志来指示使用相同的环路滤波器信息或使用各个循环过滤器信息的图像的每个块来将整个图像应用于环路滤波处理。 公开了根据本发明的用于提高效率的各种实施例，其中考虑到环路滤波器信息的各个方面以进行有效的编码，例如基于四叉树的分区的属性，块的边界条件，环路滤波器信息 在亮度和色度分量之间共享，索引到一组环路滤波器信息，以及对环路滤波器信息的预测。

公开(公告)号：US20120128067A1

公开(公告)日：2012-05-24

申请号：US13012811

申请日：2011-01-25

申请人： Shan Liu ,  Yu-Wen Huang ,  Yung-Chang Chang ,  Shaw-Min Lei

发明人： Shan Liu ,  Yu-Wen Huang ,  Yung-Chang Chang ,  Shaw-Min Lei

IPC分类号： H04N7/12

CPC分类号： H04N19/177 ,  H04N19/119 ,  H04N19/122 ,  H04N19/159 ,  H04N19/176 ,  H04N19/70 ,  H04N19/96

摘要： An apparatus and method for video coding and decoding with constrained PU partition are disclosed. In the High Efficient Video Coding (HEVC) system, rate-distortion function or other performance criterion usually is evaluated for various CU partition and PU partition during the encoding process in order to select a configuration with best possible performance. The PU design in the current HEVC development results in some redundancy that causes rate-distortion function or other performance criterion repeatedly evaluated for same PU configuration. Accordingly, constrained PU partition is developed to eliminate or reduce the redundancy in processing. Furthermore, necessary syntax to convey the information related to constrained PU partition between an encoder and a decoder is developed. Systems embodying the present invention has been shown to result in sizeable reduction in encoding and decoding time while the performance in terms of RD-rate remains approximately the same or slightly higher than a conventional HEVC system.

摘要翻译： 公开了一种用于具有约束PU分区的视频编码和解码的装置和方法。 在高效视频编码（HEVC）系统中，通常在编码过程中针对各种CU分区和PU分区评估速率失真函数或其他性能标准，以选择具有最佳性能的配置。 在当前HEVC开发中的PU设计导致一些冗余，导致对相同PU配置重复评估的速率失真功能或其他性能标准。 因此，开发了约束PU分区以消除或减少处理中的冗余。 此外，开发了在编码器和解码器之间传送与约束PU分区有关的信息的必要语法。 已经显示体现本发明的系统导致编码和解码时间的相当大的降低，而在RD速率方面的性能保持与常规HEVC系统大致相同或略高。

公开(公告)号：US20120128060A1

公开(公告)日：2012-05-24

申请号：US13047600

申请日：2011-03-14

申请人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yu-Pao Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26 ,  H04N7/32

CPC分类号： H04N19/00696 ,  H04N19/573 ,  H04N19/577

摘要： An apparatus and method for deriving a motion vector predictor or a motion vector predictor candidate or a motion vector or a motion vector candidate for a current block are disclosed. In video coding systems, the spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the information to be transmitted or stored. Motion Vector Prediction (MVP) has been used to further conserve the bitrate associated with motion vector coding. The MVP technique being developed for the current HEVC only considers the motion vector having the same reference list and the same reference picture index as the current block to be an available spatial motion vector predictor candidate. It is desirable to develop a MVP scheme that can improve the availability of the motion vector predictor candidate based on motion vectors from the spatially neighboring block. Accordingly, an apparatus and method for determining a motion vector predictor or motion vector predictor candidate or motion vector or motion vector candidate for a current block based on motion vectors associated with reference pictures in list 0 and list 1 of a neighboring block are disclosed. The improved MVP scheme may reduce motion vector residues and consequently the coding efficiency can be improved. Furthermore, the MVP scheme is based on a priority order so that the predictor can be derived at the decoder using decoded information without side information.

摘要翻译： 公开了一种用于导出运动矢量预测器或运动矢量预测器候选或用于当前块的运动矢量或运动矢量候选的装置和方法。 在视频编码系统中，使用空间和时间预测来利用空间和时间冗余来减少要发送或存储的信息。 运动矢量预测（MVP）已被用于进一步节省与运动矢量编码相关的比特率。 针对当前HEVC开发的MVP技术仅考虑具有与当前块相同的参考列表和相同参考图像索引的运动矢量作为可用的空间运动矢量预测器候选。 期望开发可以基于来自空间相邻块的运动矢量来提高运动矢量预测器候选的可用性的MVP方案。 因此，公开了一种用于基于与相邻块的列表0和列表1中的参考图片相关联的运动矢量来确定当前块的运动矢量预测器或运动矢量预测器候选或运动矢量或运动矢量候选的装置和方法。 改进的MVP方案可以减少运动矢量残差，从而可以提高编码效率。 此外，MVP方案基于优先级顺序，使得可以在解码器处使用没有副信息的解码信息来导出预测器。

公开(公告)号：US20120106622A1

公开(公告)日：2012-05-03

申请号：US12984727

申请日：2011-01-05

申请人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/426 ,  H04N19/129 ,  H04N19/14 ,  H04N19/174

摘要： In the H.264/AVC standard, one of the new characteristics is the possibility of dividing an image in regions called slice groups. The use of slice groups provides various possible advantages such as prioritized transmission, error resilient transmission, and etc. The slice groups can be formed by flexible macroblock ordering (FMO), where each picture can be divided into slice groups in different scan patterns of the macroblocks. In the high efficiency video coding (HEVC) under development, a more flexible block structure, called coding unit (CU), is used as the unit to process video data. The picture is first divided into largest CUs (LCUs) and each LCU is adaptively split into smaller CUs using a quadtree until leaf CUs are reached. In the current HEVC development, there is neither slice nor slice group structure being considered. The LCU size used for HEVC is 16 times as large as the macroblock size used in the H.264/AVC standard. Therefore, it is very desirable to develop slice and slice group structure suited for HEVC to offer various benefits of error resilience, parallel processing, reduced line (row) buffer requirement, and etc. Accordingly, slice group types including raster scan type, vertical stripe type, regions of interest type and full flexibility type are developed for HEVC. Furthermore, various syntax elements are incorporated in the sequence header or the picture header to convey information associated with the slice group structure.

摘要翻译： 在H.264 / AVC标准中，新特性之一是在称为片组的区域中划分图像的可能性。 切片组的使用提供了各种可能的优点，例如优先传输，错误弹性传输等。切片组可以通过灵活的宏块排序（FMO）形成，其中每个图像可以被分成不同扫描模式的切片组 宏块。 在正在开发的高效率视频编码（HEVC）中，使用称为编码单元（CU）的更灵活的块结构作为处理视频数据的单元。 该图片首先划分为最大的CU（LCU），并且使用四叉树将每个LCU自适应地分割成较小的CU，直到达到叶CU。 在目前的HEVC开发中，既没有考虑切片也没有切片组结构。 用于HEVC的LCU大小是H.264 / AVC标准中使用的宏块尺寸的16倍。 因此，非常希望开发适用于HEVC的切片和切片组结构，以提供错误恢复，并行处理，减少线（行）缓冲器要求等各种优点。因此，包括光栅扫描类型，垂直条纹 类型，兴趣类型和全柔性类型为HEVC开发。 此外，各种语法元素被并入到序列头或图像头中以传送与切片组结构相关联的信息。

公开(公告)号：US20120082244A1

公开(公告)日：2012-04-05

申请号：US13177343

申请日：2011-07-06

申请人： Ching-Yeh Chen ,  Chih-Ming Fu ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Ching-Yeh Chen ,  Chih-Ming Fu ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/00103 ,  H04N19/117 ,  H04N19/127 ,  H04N19/147 ,  H04N19/17 ,  H04N19/82

摘要： In a block-based motion compensated system, coding noises may arise due to lossy operations. Adaptive loop filter (ALF) is a technique used to improve the quality. A pixel adaptive (PA) ALF method was developed that uses the Sum-modified Laplacian Measure (SLM) to classify pixels and applies a respective ALF filter to each pixel according to the SLM. While the PA ALF achieves better performance over a conventional single filter (SF) based ALF, the PA ALF causes higher complexity and consumes more power due to the high complexity and per-pixel filter switching. Accordingly region based ALF scheme is disclosed which allows adaptive filter selection on a region by region basis and does not require per-pixel filter switching. In one embodiment according to the present invention, a picture is divided into M×N regions. The region based ALF also allows region merging for the M×N regions to improve performance. In another aspect of the present invention, the optimal ALF design also takes into consideration of the system complexity by using rate-distortion-complexity optimization (RDCO). The RDCO technique is also applied to sample adaptive offset (SAO) design.

摘要翻译： 在基于块的运动补偿系统中，由于有损操作可能会产生编码噪声。 自适应环路滤波器（ALF）是一种用于提高质量的技术。 开发了像素自适应（PA）ALF方法，其使用Sum-Modified Laplacian Measure（SLM）对像素进行分类，并根据SLM对每个像素应用相应的ALF滤波器。 虽然PA ALF比传统的基于单滤波器（SF）的ALF具有更好的性能，但是由于高复杂性和每像素滤波器切换，PA ALF导致更高的复杂度并且消耗更多的功率。 公开了基于区域的ALF方案，其允许在逐个区域的基础上进行自适应滤波器选择，并且不需要每像素滤波器切换。 在根据本发明的一个实施例中，图片被分成M×N个区域。 基于区域的ALF还允许区域合并M×N区域以提高性能。 在本发明的另一方面，最佳ALF设计还通过使用速率 - 失真 - 复杂度优化（RDCO）来考虑系统的复杂性。 RDCO技术也适用于采样自适应偏移（SAO）设计。

公开(公告)号：US20110222608A1

公开(公告)日：2011-09-15

申请号：US12997879

申请日：2010-11-23

申请人： Yongying Gao ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Yongying Gao ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/82 ,  H04N19/117 ,  H04N19/137 ,  H04N19/172 ,  H04N19/176 ,  H04N19/46 ,  H04N19/61 ,  H04N19/96

摘要： A method for coding a parent block of video data includes: reconstructing the parent block for prediction; providing at least two filters for filtering the parent block after reconstructing the parent block; dividing the parent block into block partitions, wherein at each block partition determining which of the filters is to be used to filter the block partition; and filtering each of the block partitions with the filter determined accordingly.

摘要翻译： 用于编码视频数据的父块的方法包括：重建用于预测的父块; 提供至少两个过滤器，用于在重建父块之后过滤父块; 将所述父块划分成块分区，其中在每个块分区确定要使用哪个过滤器来过滤所述块分区; 并用相应确定的过滤器对每个块分区进行过滤。

公开(公告)号：US20140119439A1

公开(公告)日：2014-05-01

申请号：US14123201

申请日：2012-04-18

申请人： Mei Guo ,  Xun Guo ,  Shaw-Min Lei

发明人： Mei Guo ,  Xun Guo ,  Shaw-Min Lei

IPC分类号： H04N19/593

CPC分类号： H04N19/105 ,  H04N19/00763 ,  H04N19/11 ,  H04N19/157 ,  H04N19/176 ,  H04N19/463 ,  H04N19/593 ,  H04N19/70 ,  H04N19/91

摘要： Method and apparatus for intra prediction mode coding and decoding are disclosed. In one embodiment, the encoding and decoding process assigns individual indices and codewords to DC mode and Planar mode respectively. The flag is set if the current intra prediction mode is equal to any of one or more neighboring intra prediction modes. Variable length codes are designed for a remaining mode set. If the flag is not set, the currently intra prediction mode is encoded using the variable length codes. In another embodiment, multiple most probable modes are used. If the current intra prediction mode is not equal to any of the multiple most probable modes, the current intra prediction mode is encoded using variable length codes designed for the corresponding remaining modes according the ranking order of the remaining modes.

摘要翻译： 公开了用于帧内预测模式编码和解码的方法和装置。 在一个实施例中，编码和解码过程分别将各个索引和码字分配给DC模式和平面模式。 如果当前帧内预测模式等于一个或多个相邻帧内预测模式中的任何一个，则设置该标志。 可变长度代码是为剩余模式设计的。 如果标志未被设置，则使用可变长度码对当前帧内预测模式进行编码。 在另一个实施例中，使用多个最可能的模式。 如果当前帧内预测模式不等于多个最可能模式中的任何一个，则根据剩余模式的排序顺序，使用针对相应的剩余模式设计的可变长度码来对当前帧内预测模式进行编码。