公开(公告)号：US20120106624A1

公开(公告)日：2012-05-03

申请号：US12978490

申请日：2010-12-24

申请人： Yu-Wen Huang ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Chih-Wei Hsu ,  Shan Liu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Chih-Wei Hsu ,  Shan Liu ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/439 ,  H04N19/115 ,  H04N19/117 ,  H04N19/136 ,  H04N19/174 ,  H04N19/436 ,  H04N19/61 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： An apparatus and method for video coding having intra-slice deblocking, intra-slice adaptive loop filter, and intra-slice adaptive offset are disclosed. In a video coding system, a picture is often divided into slices and each slice is independently processed so that errors or missing data from one slice cannot propagate to any other slice within the picture. In the recent high efficiency video coding (HEVC) development, deblock filtering (DF), adaptive loop filter (ALF) and adaptive offset (AO) may be applied to reconstructed slices. When the processing is applied across slice boundaries, it may rely on pixels outside the current slice and cause dependency of the current slice on other slice(s). Consequently, the DF/ALF/AO processing on a reconstructed slice may have to wait until the reconstructed slices that it is dependent from complete the DF/ALF/AO processing. To overcome the slice boundary issue, intra-slice DF/ALF/AO is developed that does not rely on any pixel outside the currently slice. An optional slice boundary filter may be applied to slice boundaries after all slices are processed by the intra-slice DF/ALF/AO.

摘要翻译： 公开了一种具有片内解块，片内自适应环路滤波器和片内自适应偏移的视频编码的装置和方法。 在视频编码系统中，图像通常被分成片，并且每个片被独立地处理，使得来自一个片的错误或丢失的数据不能传播到图片内的任何其他片。 在最近的高效率视频编码（HEVC）开发中，解块滤波（DF），自适应环路滤波器（ALF）和自适应偏移（AO）可以应用于重构的片段。 当跨越切片边界应用处理时，它可以依赖于当前切片外部的像素，并且导致当前切片对其他切片的依赖。 因此，在重构的切片上的DF / ALF / AO处理可能必须等待直至重构的切片依赖于完成DF / ALF / AO处理。 为了克服切片边界问题，开发了片内DF / ALF / AO，其不依赖于当前切片之外的任何像素。 在片内DF / ALF / AO处理所有片段之后，可选择的片边界滤波器可应用于片边界。

公开(公告)号：US09525884B2

公开(公告)日：2016-12-20

申请号：US12978490

申请日：2010-12-24

申请人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shan Liu ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Shan Liu ,  Shaw-Min Lei

IPC分类号： H04N19/86 ,  H04N19/70 ,  H04N19/436 ,  H04N19/42 ,  H04N19/174 ,  H04N19/117 ,  H04N19/136 ,  H04N19/82 ,  H04N19/13 ,  H04N7/26 ,  H04N19/115 ,  H04N19/61

CPC分类号： H04N19/439 ,  H04N19/115 ,  H04N19/117 ,  H04N19/136 ,  H04N19/174 ,  H04N19/436 ,  H04N19/61 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86

摘要： An apparatus and method for video coding having intra-slice deblocking, intra-slice adaptive loop filter, and intra-slice adaptive offset are disclosed. In a video coding system, a picture is often divided into slices and each slice is independently processed so that errors or missing data from one slice cannot propagate to any other slice within the picture. In the recent high efficiency video coding (HEVC) development, deblock filtering (DF), adaptive loop filter (ALF) and adaptive offset (AO) may be applied to reconstructed slices. When the processing is applied across slice boundaries, it may rely on pixels outside the current slice and cause dependency of the current slice on other slice(s). Consequently, the DF/ALF/AO processing on a reconstructed slice may have to wait until the reconstructed slices that it is dependent from complete the DF/ALF/AO processing. To overcome the slice boundary issue, intra-slice DF/ALF/AO is developed that does not rely on any pixel outside the currently slice. An optional slice boundary filter may be applied to slice boundaries after all slices are processed by the intra-slice DF/ALF/AO.

摘要翻译： 公开了一种具有片内解块，片内自适应环路滤波器和片内自适应偏移的视频编码的装置和方法。 在视频编码系统中，图像通常被分成片，并且每个片被独立地处理，使得来自一个片的错误或丢失的数据不能传播到图片内的任何其他片。 在最近的高效率视频编码（HEVC）开发中，解块滤波（DF），自适应环路滤波器（ALF）和自适应偏移（AO）可以应用于重构的片段。 当跨越切片边界应用处理时，它可以依赖于当前切片外部的像素，并且导致当前切片对其他切片的依赖。 因此，在重构的切片上的DF / ALF / AO处理可能必须等待直至重构的切片依赖于完成DF / ALF / AO处理。 为了克服切片边界问题，开发了片内DF / ALF / AO，其不依赖于当前切片之外的任何像素。 在片内DF / ALF / AO处理所有片段之后，可选择的片边界滤波器可应用于片边界。

公开(公告)号：US09788019B2

公开(公告)日：2017-10-10

申请号：US13156552

申请日：2011-06-09

申请人： Shan Liu ,  Zhi Zhou ,  Shaw-Min Lei

发明人： Shan Liu ,  Zhi Zhou ,  Shaw-Min Lei

IPC分类号： H04N11/02 ,  H04N19/96 ,  H04N19/176 ,  H04N19/70 ,  H04N19/119

CPC分类号： H04N19/96 ,  H04N19/119 ,  H04N19/176 ,  H04N19/70

摘要： Transform unit (TU) partition method and apparatus depending on the coding unit (CU) partition and prediction unit (PU) partition are disclosed. In one embodiment, the maximum TU size is restricted to the minimum of PU width and height, except for a 2N×2N coding unit with the 2N×2N partition type. In another embodiment, the maximum TU size equals to maximum of PU width and height, and the minimum TU size equals to minimum of the PU width and height, except for a 2N×2N coding unit with the 2N×2N partition type. In yet another embodiment, the maximum TU size is equal to the maximum of PU width and height, and the minimum TU size is equal to the minimum of PU width and height except for a 2N×2N CU with 2N×2N partition type.

公开(公告)号：US09049452B2

公开(公告)日：2015-06-02

申请号：US13272221

申请日：2011-10-13

申请人： Shan Liu ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Shan Liu ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04B1/66 ,  H04N19/463 ,  H04N19/176 ,  H04N19/119 ,  H04N19/147 ,  H04N19/96 ,  H04N7/26 ,  H04N19/159

CPC分类号： H04N19/51 ,  H04N19/119 ,  H04N19/13 ,  H04N19/147 ,  H04N19/157 ,  H04N19/159 ,  H04N19/176 ,  H04N19/44 ,  H04N19/46 ,  H04N19/463 ,  H04N19/647 ,  H04N19/91 ,  H04N19/96

摘要： In HEVC (High Efficiency Video Coding), a 2N×2N coding unit can be partitioned into various partition types hierarchically. The coding system uses a criterion to determine the best partition, where RD-rate is often used as the criterion. N×N partition at level k becomes redundant if 2N×2N at level k+1 will be evaluated. In order to eliminate the above redundancy, the allowable partition sizes are constrained according to a method previously disclosed. In the current invention, the complexity is further reduced. According to one embodiment, N×N partition is not allowed for any INTER mode regardless of the coding unit size. Furthermore, flexibility is provided so that either the method and apparatus with further complexity reduction can be selected or an alternative method and apparatus can be selected. Syntaxes to support embodiments according to the present invention are also disclosed.

摘要翻译： 在HEVC（高效率视频编码）中，2N×2N个编码单元可以分层划分成各种分区类型。 编码系统使用标准来确定最佳分区，其中通常使用RD率作为标准。 如果在级别k + 1处的2N×2N将被评估，则级别k的N×N分区变得冗余。 为了消除上述冗余，根据先前公开的方法来限制允许的分区大小。 在本发明中，复杂性进一步降低。 根据一个实施例，无论编码单元大小如何，对于任何INTER模式，不允许N×N分区。 此外，提供灵活性，使得可以选择具有进一步复杂度降低的方法和装置，或者可以选择替代方法和装置。 还公开了用于支持根据本发明的实施例的语法。

公开(公告)号：US20140140404A1

公开(公告)日：2014-05-22

申请号：US14234152

申请日：2012-07-26

申请人： Shan Liu ,  Ximin Zhang ,  Shaw-Min Lei

发明人： Shan Liu ,  Ximin Zhang ,  Shaw-Min Lei

IPC分类号： H04N19/105 ,  H04N19/182 ,  H04N19/136

CPC分类号： H04N19/105 ,  H04N19/11 ,  H04N19/119 ,  H04N19/122 ,  H04N19/132 ,  H04N19/136 ,  H04N19/147 ,  H04N19/176 ,  H04N19/182 ,  H04N19/33 ,  H04N19/593 ,  H04N19/70

摘要： A method and apparatus for Intra prediction of a block based on neighboring pixels around the block are disclosed. Embodiments according to the present invention use square blocks as well as non-square blocks for Intra prediction. For a 2N×2N Luma CU (coding unit), the CU can be partitioned into 2N×N, N×2N, 2N×2N or N×N PUs. The 2N×N and N×2N PUs can be further processed by either square transforms only or both non-square and square transforms. In one embodiment, the 2N×N PU or the N×2N PU is processed as two N×N TUs (transform units) and each of the N×N TU is further split into smaller N×N TUs based on quad-tree split. In another embodiment, the 2N×N and N×2N PUs are processed as two 2N×0.5N and 0.5N×2N TUs respectively.

摘要翻译： 公开了一种基于块周围的相邻像素进行帧内预测的方法和装置。 根据本发明的实施例使用平方块以及用于帧内预测的非方块。 对于2N×2N亮度CU（编码单元），CU可以划分为2N×N，N×2N，2N×2N或N×N个PU。 2N×N和N×2N个PU可以通过正方形变换或非正方形和正方形变换进一步处理。 在一个实施例中，2N×N PU或N×2N PU被处理为两个N×N个TU（变换单元），并且N×N TU中的每一个进一步被分割成基于四叉树分割的较小的N×N个TU 。 在另一个实施例中，2N×N和N×2N个PU分别被处理为两个2N×0.5N和0.5N×2N个TU。

公开(公告)号：US20120195366A1

公开(公告)日：2012-08-02

申请号：US13108055

申请日：2011-05-16

申请人： Shan Liu ,  Ximin Zhang ,  Shaw-Min Lei

发明人： Shan Liu ,  Ximin Zhang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/174 ,  H04N19/13 ,  H04N19/159 ,  H04N19/61 ,  H04N19/70

摘要： A method and apparatus for adaptive inter prediction mode coding are disclosed. In the current HEVC, a fixed set of variable length codes is used for the underlying video data, which may not optimally match the statistics of underlying video data. Consequently, the compression efficiency associated with the fixed set of variable length codes will be compromised. Accordingly, an adaptive coding scheme for inter prediction modes is disclosed. The variable length codes used for each inter prediction mode in each coding unit depth is adaptively determined by its respective statistics. The statistics can be measured as the frequency of occurrence of each mode. In one embodiment according to the present invention, counters are used to collect the statistics. According to one embodiment of the present invention, the statistics of inter prediction modes are collected from the previous slice and the set of variable length codes is determined for the subsequent slice (immediately following the previous slice) accordingly. According to another embodiment of the present invention, the statistics of inter prediction modes are updated for each coding unit and the variable length code for each mode is adjusted according to the statistics change during the coding process. According to another embodiment of the present invention, the variable length code for each mode is reset in the beginning of each slice. The reset code word table is either a predefined code word table for whole sequence or a code word table determined by the previous slice.

摘要翻译： 公开了一种自适应帧间预测模式编码的方法和装置。 在当前的HEVC中，一组固定的可变长度代码用于底层视频数据，这可能不能最佳地匹配底层视频数据的统计。 因此，与固定的可变长度代码组相关联的压缩效率将受到损害。 因此，公开了一种用于帧间预测模式的自适应编码方案。 在每个编码单元深度中用于每个帧间预测模式的可变长度码由其各自的统计量自适应地确定。 统计量可以作为每种模式发生的频率进行测量。 在根据本发明的一个实施例中，使用计数器来收集统计信息。 根据本发明的一个实施例，从先前的片段收集帧间预测模式的统计，并且相应地为随后的片段（紧接着先前的片段）确定可变长度码集合。 根据本发明的另一实施例，针对每个编码单元更新帧间预测模式的统计，并且根据编码处理期间的统计变化来调整每种模式的可变长度码。 根据本发明的另一实施例，每个模式的可变长度代码在每个切片的开头被复位。 复位码字表是用于整个序列的预定义码字表或由先前片确定的码字表。

公开(公告)号：US20120128067A1

公开(公告)日：2012-05-24

申请号：US13012811

申请日：2011-01-25

申请人： Shan Liu ,  Yu-Wen Huang ,  Yung-Chang Chang ,  Shaw-Min Lei

发明人： Shan Liu ,  Yu-Wen Huang ,  Yung-Chang Chang ,  Shaw-Min Lei

IPC分类号： H04N7/12

CPC分类号： H04N19/177 ,  H04N19/119 ,  H04N19/122 ,  H04N19/159 ,  H04N19/176 ,  H04N19/70 ,  H04N19/96

摘要： An apparatus and method for video coding and decoding with constrained PU partition are disclosed. In the High Efficient Video Coding (HEVC) system, rate-distortion function or other performance criterion usually is evaluated for various CU partition and PU partition during the encoding process in order to select a configuration with best possible performance. The PU design in the current HEVC development results in some redundancy that causes rate-distortion function or other performance criterion repeatedly evaluated for same PU configuration. Accordingly, constrained PU partition is developed to eliminate or reduce the redundancy in processing. Furthermore, necessary syntax to convey the information related to constrained PU partition between an encoder and a decoder is developed. Systems embodying the present invention has been shown to result in sizeable reduction in encoding and decoding time while the performance in terms of RD-rate remains approximately the same or slightly higher than a conventional HEVC system.

摘要翻译： 公开了一种用于具有约束PU分区的视频编码和解码的装置和方法。 在高效视频编码（HEVC）系统中，通常在编码过程中针对各种CU分区和PU分区评估速率失真函数或其他性能标准，以选择具有最佳性能的配置。 在当前HEVC开发中的PU设计导致一些冗余，导致对相同PU配置重复评估的速率失真功能或其他性能标准。 因此，开发了约束PU分区以消除或减少处理中的冗余。 此外，开发了在编码器和解码器之间传送与约束PU分区有关的信息的必要语法。 已经显示体现本发明的系统导致编码和解码时间的相当大的降低，而在RD速率方面的性能保持与常规HEVC系统大致相同或略高。

公开(公告)号：US10063876B2

公开(公告)日：2018-08-28

申请号：US14123200

申请日：2012-06-12

申请人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/36 ,  H04N19/513 ,  H04N19/52 ,  H04N19/119 ,  H04N19/625 ,  H04N19/70

CPC分类号： H04N19/513 ,  H04N19/119 ,  H04N19/52 ,  H04N19/625 ,  H04N19/70

摘要： A method and apparatus derive a motion vector predictor (MVP) for a current block in an Inter, Merge, or Skip mode. Embodiments according to the present invention determine redundant MVP candidates according to a non-MV-value based criterion. The redundant MVP candidates are then removed from the MVP candidate set. In other embodiments according to the present invention, motion IDs are assigned to MVP candidates to follow the trail of motion vectors associated with the MVP candidate. An MVP candidate having a same motion ID as a previous MVP is redundant and can be removed from the MVP candidate set. In yet another embodiment, redundant MVP candidates correspond to one or more of the MVP candidates that cause the second 2N×N or N×2N PU to be merged into a 2N×2N PU are removed from the MVP candidate set.

公开(公告)号：US09872015B2

公开(公告)日：2018-01-16

申请号：US13992472

申请日：2012-04-20

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N19/117 ,  H04N19/70 ,  H04N19/177 ,  H04N19/463 ,  H04N19/82

CPC分类号： H04N19/169 ,  H04N19/117 ,  H04N19/177 ,  H04N19/463 ,  H04N19/70 ,  H04N19/82

摘要： Video decoding and encoding with in-loop processing of reconstructed video are disclosed. At the decoder side, a flag is received from the video bitstream and according to the flag, information associated with in-loop filter parameters is received either from a data payload in the video bitstream to be shared by two or more coding blocks or individual coding block data in the video bitstream. At the encoder side, information associated with the in-loop filter parameters is incorporated either in a data payload in a video bitstream to be shared by two or more coding blocks or interleaved with individual coding block data in the video bitstream according to a flag. The data payload in the video bitstream is in a picture level, Adaptation Parameter Set (APS), or a slice header.

公开(公告)号：US09813738B2

公开(公告)日：2017-11-07

申请号：US13216242

申请日：2011-08-24

申请人： Chia-Yang Tsai ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N19/82 ,  H04N19/42 ,  H04N19/80 ,  H04N19/147 ,  H04N19/176 ,  H04N19/17 ,  H04N19/182 ,  H04N19/119 ,  H04N19/117

CPC分类号： H04N19/82 ,  H04N19/117 ,  H04N19/119 ,  H04N19/147 ,  H04N19/17 ,  H04N19/176 ,  H04N19/182 ,  H04N19/439 ,  H04N19/80

摘要： A method and apparatus for processing in-loop reconstructed video using an in-loop filter is disclosed. In the recent HEVC development, adaptive loop filtering (ALF) is being adopted to process in-loop reconstruction video data, where ALF can be selectively turned ON or OFF for each block in a frame or a slice. An advanced ALF is disclosed later that allows a choice of multiple filter sets that can be applied to the reconstructed video data adaptively. In the present disclosure, pixels of the in-loop reconstructed video data are divided into a plurality of to-be-filtered regions, and an in-loop filter from a filter set is determined for each to-be-filtered region based on a rate-distortion optimization procedure. According to one embodiment of the present invention, computation of cost function associated with the rate-distortion optimization procedure is related to correlation values associated with original video data and the in-loop reconstructed video data. Furthermore, the correlation values can be shared by the multiple candidate filters during the rate-distortion optimization procedure for said each to-be-filtered region. In another embodiment, the correlation values can be shared by multiple candidate to-be-filtered regions of an area of the in-loop reconstructed video data during the rate-distortion optimization procedure for the area of the in-loop reconstructed video data.