公开(公告)号：US09872015B2

公开(公告)日：2018-01-16

申请号：US13992472

申请日：2012-04-20

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N19/117 ,  H04N19/70 ,  H04N19/177 ,  H04N19/463 ,  H04N19/82

CPC分类号： H04N19/169 ,  H04N19/117 ,  H04N19/177 ,  H04N19/463 ,  H04N19/70 ,  H04N19/82

摘要： Video decoding and encoding with in-loop processing of reconstructed video are disclosed. At the decoder side, a flag is received from the video bitstream and according to the flag, information associated with in-loop filter parameters is received either from a data payload in the video bitstream to be shared by two or more coding blocks or individual coding block data in the video bitstream. At the encoder side, information associated with the in-loop filter parameters is incorporated either in a data payload in a video bitstream to be shared by two or more coding blocks or interleaved with individual coding block data in the video bitstream according to a flag. The data payload in the video bitstream is in a picture level, Adaptation Parameter Set (APS), or a slice header.

公开(公告)号：US09813738B2

公开(公告)日：2017-11-07

申请号：US13216242

申请日：2011-08-24

申请人： Chia-Yang Tsai ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Chia-Yang Tsai ,  Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N19/82 ,  H04N19/42 ,  H04N19/80 ,  H04N19/147 ,  H04N19/176 ,  H04N19/17 ,  H04N19/182 ,  H04N19/119 ,  H04N19/117

CPC分类号： H04N19/82 ,  H04N19/117 ,  H04N19/119 ,  H04N19/147 ,  H04N19/17 ,  H04N19/176 ,  H04N19/182 ,  H04N19/439 ,  H04N19/80

摘要： A method and apparatus for processing in-loop reconstructed video using an in-loop filter is disclosed. In the recent HEVC development, adaptive loop filtering (ALF) is being adopted to process in-loop reconstruction video data, where ALF can be selectively turned ON or OFF for each block in a frame or a slice. An advanced ALF is disclosed later that allows a choice of multiple filter sets that can be applied to the reconstructed video data adaptively. In the present disclosure, pixels of the in-loop reconstructed video data are divided into a plurality of to-be-filtered regions, and an in-loop filter from a filter set is determined for each to-be-filtered region based on a rate-distortion optimization procedure. According to one embodiment of the present invention, computation of cost function associated with the rate-distortion optimization procedure is related to correlation values associated with original video data and the in-loop reconstructed video data. Furthermore, the correlation values can be shared by the multiple candidate filters during the rate-distortion optimization procedure for said each to-be-filtered region. In another embodiment, the correlation values can be shared by multiple candidate to-be-filtered regions of an area of the in-loop reconstructed video data during the rate-distortion optimization procedure for the area of the in-loop reconstructed video data.

公开(公告)号：US20170310958A1

公开(公告)日：2017-10-26

申请号：US15521499

申请日：2015-11-04

申请人： Han HUANG ,  Ching-Yeh CHEN ,  Chih-Wei HSU

发明人： Han HUANG ,  Ching-Yeh CHEN ,  Chih-Wei HSU

IPC分类号： H04N19/105 ,  H04N19/176 ,  H04N19/196 ,  H04N19/70

CPC分类号： H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/197 ,  H04N19/198 ,  H04N19/593 ,  H04N19/70

摘要： A method and apparatus for video encoding and decoding with prediction offset in a video coding system are disclosed. A prediction offset for a current block is derived from a reconstructed residual signal of one or more coded blocks. At the encoder side, a residual signal for the current block is calculated by subtracting a prediction signal and the prediction offset from an original signal of the current block, and the residual signal is encoded to generate an encoded bitstream. At the decoder side, a residual signal for the current block is obtained from input data, a reconstructed signal for the current block is calculated by adding a prediction signal and the prediction offset to the residual signal, and the current block is decoded using the reconstructed signal.

公开(公告)号：US09456111B2

公开(公告)日：2016-09-27

申请号：US12954844

申请日：2010-11-26

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang

IPC分类号： H04N19/182 ,  H04N5/21 ,  H04N19/70 ,  H04N19/46 ,  H04N19/61 ,  H04N19/14 ,  H04N19/82 ,  H04N19/86

CPC分类号： H04N19/182 ,  H04N5/21 ,  H04N5/2173 ,  H04N19/14 ,  H04N19/186 ,  H04N19/44 ,  H04N19/46 ,  H04N19/61 ,  H04N19/625 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86 ,  H04N19/91

摘要： A system and method of content adaptive pixel intensity processing are described. In video processing system, due to various mathematic operations applied to the data, the processed video data may be become exceeding a range of original data and result in artifacts. Content adaptive clipping method is disclosed which takes into account the dynamic characteristics of the video data. Accordingly the method configures the video data into a predefined set which can be a partial picture, a frame or a group of frames. The data range of the original associated with the predefined set is determined The processed video data is clipped according to the range computed for the predefined set.

摘要翻译： 描述了内容自适应像素强度处理的系统和方法。 在视频处理系统中，由于应用于数据的各种数学运算，经处理的视频数据可能会超出原始数据的范围并导致伪像。 公开了考虑到视频数据的动态特性的内容自适应剪辑方法。 因此，该方法将视频数据配置成可以是部分图像，帧或一组帧的预定义集合。 确定与预定义集合相关联的原稿的数据范围。根据针对预定义集合计算的范围来剪切处理的视频数据。

公开(公告)号：US09300963B2

公开(公告)日：2016-03-29

申请号：US13879903

申请日：2012-01-19

申请人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Chih-Ming Fu ,  Chi-Ling Wu ,  Yu-Pao Tsai ,  Ching-Yeh Chen ,  Shaw-Min Lei

发明人： Jian-Liang Lin ,  Yi-Wen Chen ,  Yu-Wen Huang ,  Chih-Ming Fu ,  Chi-Ling Wu ,  Yu-Pao Tsai ,  Ching-Yeh Chen ,  Shaw-Min Lei

IPC分类号： H04N11/02 ,  H04N19/65 ,  H04N19/52

CPC分类号： H04N19/109 ,  H04N19/119 ,  H04N19/139 ,  H04N19/147 ,  H04N19/174 ,  H04N19/177 ,  H04N19/184 ,  H04N19/52 ,  H04N19/567 ,  H04N19/593 ,  H04N19/615 ,  H04N19/65 ,  H04N19/70 ,  H04N19/895

摘要： A method and apparatus for deriving a motion vector predictor (MVP) are disclosed. The MVP is selected from spatial MVP and temporal MVP candidates. The method uses a flag to indicate whether temporal MVP candidates are disabled. If the flag indicates that the temporal MVP candidates are disabled, the MVP is derived from the spatial MVP candidates only. Otherwise, the MVP is derived from the spatial and temporal MVP candidates. The method may further skip spatial redundant MVP removal by comparing MV values. Furthermore, the parsing error robustness scheme determines a forced temporal MVP when a temporal MVP is not available and the temporal MVP candidates are allowed as indicated by the flag. The flag may be incorporated in sequence, picture, slice level, or a combination of these levels.

摘要翻译： 公开了一种用于导出运动矢量预测器（MVP）的方法和装置。 MVP从空间MVP和时间MVP候选中选择。 该方法使用标志来指示是否禁用时间MVP候选。 如果标志指示时间MVP候选被禁用，则MVP仅从空间MVP候选导出。 否则，MVP是从空间和时间MVP候选导出的。 该方法可以通过比较MV值来进一步跳过空间冗余MVP去除。 此外，解析误差鲁棒性方案在时间MVP不可用时确定强制时间MVP，并且如标志所指示的那样允许时间MVP候选。 标志可以按序列，图片，切片级别或这些级别的组合来合并。

公开(公告)号：US08660174B2

公开(公告)日：2014-02-25

申请号：US12987151

申请日：2011-01-09

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang

IPC分类号： H04N7/32 ,  H04N7/26

CPC分类号： H04N19/86 ,  H04N19/107 ,  H04N19/117 ,  H04N19/182 ,  H04N19/46 ,  H04N19/61 ,  H04N19/82

摘要： The method selects a region for processed video data and determines a class for each pixel in the region of the processed video data based on characteristic measurement of said each pixel. The processed video data corresponds to the reconstructed, deblocked reconstructed or deblocked-and-loop-filtered reconstructed video data. An intensity offset is then determined for the class according to the pixels in the region of the processed video data and respective pixels in a respective region of associated original video data. The intensive offset determined is applied to the processed video data to compensate the intensity offset. The region is smaller than a picture so that adaptive offset can adapt to dynamic characteristics of a picture. In one embodiment, the characteristic measurement is based on pixel patterns consisting pixels around an underlying pixel.

摘要翻译： 该方法选择用于经处理的视频数据的区域，并且基于所述每个像素的特征测量确定经处理的视频数据区域中每个像素的类别。 经处理的视频数据对应于重构的解块重构或解块和循环滤波的重构视频数据。 然后根据处理的视频数据的区域中的像素和相关联的原始视频数据的相应区域中的各个像素，确定类的强度偏移。 确定的密集偏移被应用于经处理的视频数据以补偿强度偏移。 该区域小于图像，使得自适应偏移可以适应图像的动态特性。 在一个实施例中，特征测量基于围绕下面的像素的像素组成的像素图案。

公开(公告)号：US20130215959A1

公开(公告)日：2013-08-22

申请号：US13825061

申请日：2011-12-31

申请人： Ching-Yeh Chen ,  Chih-Ming Fu ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

发明人： Ching-Yeh Chen ,  Chih-Ming Fu ,  Chia-Yang Tsai ,  Yu-Wen Huang ,  Shaw-Min Lei

IPC分类号： H04N7/26

CPC分类号： H04N19/103 ,  H04N19/117 ,  H04N19/46 ,  H04N19/70 ,  H04N19/82

摘要： Methods for filter-unit based in-loop filtering in a video decoder and encoder are disclosed. In one embodiment, filter parameters are selected from a filter parameter set for each filter based on a filter index. In another embodiment, the picture is partitioned into filter units according to filter unit size, which can be selected between a default size and other size. When other size is selected, the filter unit size may be conveyed using direct size information or ratio information. In another embodiment, a merge flag and a merge index are used to convey filter unit merge information. A method for filter-unit based in-loop filtering in a video encoder for color video is disclosed. In one embodiment, the method incorporates filter syntax in the video bitstream by interleaving the color-component filter syntax for the FUs.

摘要翻译： 公开了一种视频解码器和编码器中基于滤波器单元的环路滤波方法。 在一个实施例中，基于滤波器索引从针对每个滤波器的滤波器参数集中选择滤波器参数。 在另一个实施例中，根据滤波器单元尺寸将图像划分为滤波器单元，其可以在默认尺寸和其它尺寸之间进行选择。 当选择其他尺寸时，可以使用直接尺寸信息或比率信息来传送过滤器单元尺寸。 在另一个实施例中，使用合并标志和合并索引来传送过滤器单元合并信息。 公开了一种用于彩色视频的视频编码器中的基于滤波器单元的环路滤波的方法。 在一个实施例中，该方法通过交织FU的颜色分量滤波器语法来在视频比特流中包含滤波器语法。

公开(公告)号：US20120114034A1

公开(公告)日：2012-05-10

申请号：US13018431

申请日：2011-02-01

申请人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Yu-Lin Chang ,  Tzu-Der Chuang ,  Shaw-Min Lei

发明人： Yu-Wen Huang ,  Ching-Yeh Chen ,  Chih-Ming Fu ,  Chih-Wei Hsu ,  Yu-Lin Chang ,  Tzu-Der Chuang ,  Shaw-Min Lei

IPC分类号： H04N7/12

CPC分类号： H04N19/174 ,  H04N19/103 ,  H04N19/119 ,  H04N19/126 ,  H04N19/13 ,  H04N19/146 ,  H04N19/159 ,  H04N19/176 ,  H04N19/18 ,  H04N19/463 ,  H04N19/70 ,  H04N19/96

摘要： In the current high efficiency video coding development, each LCU has its own quantization parameter (QP) and the difference between a current QP and a reference QP is transmitted instead of the QP value itself. Since the LCU is much larger than the macroblock of AVC/H.264, using one delta QP per LCU may cause rate control unable to adapt to the bitrate quickly enough. Consequently there is a need to adopt delta QP in units smaller than LCU to provide more granular rate control. Furthermore, it is desirable to develop a system that is capable of facilitating more flexible delta QP. Accordingly, adaptive quantization parameter processing is disclosed where a QP minimum CU size for incorporating or deriving a delta QP is indicated selectively in the slice level or in the sequence/picture level. In one variation, the delta QP is incorporated or derived only if nonzero quantized transform coefficients exist in a leaf CU that is larger than the QP minimum CU size. In another variation, quantization parameter information is only incorporated or derived when a leaf CU has any nonzero quantized transform coefficient. In yet another variation, a flag is used to indicate whether one delta QP per LCU is transmitted if the LCU has any nonzero quantized transform coefficient or one delta QP per leaf CU is transmitted if the leaf CU has any nonzero quantized transform coefficient.

摘要翻译： 在当前的高效率视频编码开发中，每个LCU具有其自己的量化参数（QP），并且发送当前QP与参考QP之间的差异而不是QP值本身。 由于LCU比AVC / H.264的宏块大得多，因此使用每个LCU的一个delta QP可能导致速率控制不能足够快地适应比特率。 因此，需要采用小于LCU的单位的delta QP来提供更细粒度的速率控制。 此外，期望开发能够促进更灵活的delta QP的系统。 因此，公开了自适应量化参数处理，其中用于合并或导出增量QP的QP最小CU尺寸在片级或序列/画面级别中有选择地表示。 在一个变型中，只有当非零量化变换系数存在于大于QP最小CU尺寸的叶CU中时，才加入或推导增量QP。 在另一个变型中，当叶CU具有任何非零量化变换系数时，仅结合或导出量化参数信息。 在又一个变型中，如果LCU具有任何非零量化变换系数，或者如果叶CU具有任何非零量化变换系数，则发送每个叶CU，则发送每个LCU一个ΔQP是否被发送的标志。

公开(公告)号：US20110305277A1

公开(公告)日：2011-12-15

申请号：US12954844

申请日：2010-11-26

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang

IPC分类号： H04N7/32 ,  H04N5/21

CPC分类号： H04N19/182 ,  H04N5/21 ,  H04N5/2173 ,  H04N19/14 ,  H04N19/186 ,  H04N19/44 ,  H04N19/46 ,  H04N19/61 ,  H04N19/625 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86 ,  H04N19/91

摘要： A system and method of content adaptive pixel intensity processing are described. In video processing system, due to various mathematic operations applied to the data, the processed video data may be become exceeding a range of original data and result in artifacts. Content adaptive clipping method is disclosed which takes into account the dynamic characteristics of the video data. Accordingly the method configures the video data into a predefined set which can be a partial picture, a frame or a group of frames. The data range of the original associated with the predefined set is determined The processed video data is clipped according to the range computed for the predefined set.

摘要翻译： 描述了内容自适应像素强度处理的系统和方法。 在视频处理系统中，由于应用于数据的各种数学运算，经处理的视频数据可能会超出原始数据的范围并导致伪像。 公开了考虑到视频数据的动态特性的内容自适应剪辑方法。 因此，该方法将视频数据配置成可以是部分图像，帧或一组帧的预定义集合。 确定与预定义集合相关联的原稿的数据范围。根据针对预定义集合计算的范围来剪切处理的视频数据。

公开(公告)号：US20110274158A1

公开(公告)日：2011-11-10

申请号：US13093068

申请日：2011-04-25

申请人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Chia-Yang Tsai ,  Shaw-Min Lei

发明人： Chih-Ming Fu ,  Ching-Yeh Chen ,  Yu-Wen Huang ,  Chia-Yang Tsai ,  Shaw-Min Lei

IPC分类号： H04N11/02

CPC分类号： H04N19/117 ,  H04N19/10 ,  H04N19/115 ,  H04N19/129 ,  H04N19/134 ,  H04N19/137 ,  H04N19/14 ,  H04N19/154 ,  H04N19/157 ,  H04N19/159 ,  H04N19/174 ,  H04N19/176 ,  H04N19/186 ,  H04N19/196 ,  H04N19/439 ,  H04N19/463 ,  H04N19/82 ,  H04N19/86 ,  H04N19/96

摘要： In a block-based motion compensated system, coding noises may arise due to lossy operations such as quantization. Deblocking is often used to alleviate visibility of coding artifacts by applying filtering across block boundaries adaptively. In the recent HEVC development, adaptive loop filtering (ALF) is being adopted to process deblocked reconstruction frames. Adaptive loop filtering is applied to reconstructed video data across multiple frames to reduce visibility of coding artifacts in the temporal domain. In a HEVC system, conventional ALF can be selectively turned ON or OFF for each block in a frame or a slice. The advanced ALF disclosed here allows a choice of multiple filter sets that can be applied to the reconstructed video data adaptively. Furthermore, the advanced ALF adopts a new unit for the filtering process to apply so that more flexible and/or localized processing can be provided. Furthermore, the advanced ALF allows a decoder to derive respective information for applying the filtering process without side information.

摘要翻译： 在基于块的运动补偿系统中，由于诸如量化的有损操作，可能产生编码噪声。 解块通常用于通过自适应地跨越块边界应用过滤来减轻编码伪像的可视性。 在最近的HEVC开发中，正在采用自适应环路滤波（ALF）来处理解块重建帧。 自适应环路滤波被应用于跨多帧的重建视频数据，以减少时域中编码伪像的可见性。 在HEVC系统中，对于帧或片中的每个块，可以选择性地将常规ALF打开或关闭。 这里公开的高级ALF允许选择可以自适应地应用于重建的视频数据的多个滤波器组。 此外，先进的ALF采用新的过滤单元进行应用，从而可以提供更灵活和/或本地化的处理。 此外，高级ALF允许解码器导出用于应用无侧信息的过滤处理的相应信息。