公开(公告)号：US09288453B2

公开(公告)日：2016-03-15

申请号：US14113005

申请日：2011-04-22

申请人： Wenfei Jiang ,  Zhibo Chen ,  Fan Zhang

发明人： Wenfei Jiang ,  Zhibo Chen ,  Fan Zhang

IPC分类号： G06K9/36 ,  H04N19/50 ,  H04N19/147 ,  H04N19/60 ,  H04N19/124 ,  H04N19/132 ,  H04N19/18 ,  H04N19/467 ,  H04N19/86

CPC分类号： H04N19/50 ,  H04N19/124 ,  H04N19/132 ,  H04N19/147 ,  H04N19/18 ,  H04N19/467 ,  H04N19/60 ,  H04N19/86

摘要： The invention proposes modification of quantized coefficients for signalling of a post-processing method. Therefore, it is proposed a method for lossy compress-encoding data comprising at least one of image data and audio data. Said method comprises determining quantized coefficients using a quantization of a discrete cosine transformed residual of a prediction of said data. Said method further comprises modifying said quantized coefficients for minimizing rate-distortion cost wherein distortion is determined using a post-processed reconstruction of the data, the post-processed reconstruction being post-processed according to a postprocessing method, and compress-encoding said modified coefficients. In said proposed method, the post-processing method is that one of n>1 different predetermined post processing method candidates whose position in an predetermined order of arrangement of the post processing method candidates equals a remainder of division, by n, of a sum of the modified coefficients. Doing so removes the overhead of flags in the bit stream.

摘要翻译： 本发明提出了对后处理方法的信令的量化系数的修改。 因此，提出了一种包括图像数据和音频数据中的至少一个的有损压缩编码数据的方法。 所述方法包括使用所述数据的预测的离散余弦变换残差的量化来确定量化系数。 所述方法还包括修改所述量化系数以最小化速率失真成本，其中使用数据的后处理重建来确定失真，后处理重建根据后处理方法进行后处理，并且对所述修改系数进行压缩编码 。 在所述提出的方法中，后处理方法是以后处理方法候补的预定排列顺序的位置等于n除以n的余数的n≥1个不同的预定后处理方法候选中的一个， 修正系数。 这样做会消除位流中标志的开销。

公开(公告)号：US09930329B2

公开(公告)日：2018-03-27

申请号：US14353811

申请日：2011-11-03

申请人： Wenfei Jiang ,  Fan Zhang ,  Zhibo Chen

发明人： Wenfei Jiang ,  Fan Zhang ,  Zhibo Chen

IPC分类号： H04N19/136 ,  H04N19/176 ,  H04N19/147 ,  H04N19/103 ,  H04N19/117 ,  H04N19/132 ,  H04N19/14 ,  H04N19/82 ,  H04N19/124 ,  H04N19/192 ,  H04N19/86

CPC分类号： H04N19/86 ,  H04N19/103 ,  H04N19/117 ,  H04N19/124 ,  H04N19/132 ,  H04N19/14 ,  H04N19/147 ,  H04N19/176 ,  H04N19/192 ,  H04N19/82

摘要： A particular implementation forms an initial reconstructed image block from inverse quantization and inverse transform, and further refines the reconstructed image block using pixels from neighboring reconstructed blocks. The image block may be refined using a bilateral filter, whose space parameter and range parameter are adaptive to the quantization parameter. The particular implementation can be used in both encoding and decoding when reconstructing an image block. When used in encoding, the particular implementation can be used jointly with coefficient truncation, where some non-zero transform coefficients are set to zero. The number of remaining non-zero transform coefficients after coefficient truncation may be adaptive to the quantization parameter, the variance of the image block, the number of non-zero transform coefficients of the image block, and the index of the last non-zero transform coefficient in a zigzag scanning order.

公开(公告)号：US20140254676A1

公开(公告)日：2014-09-11

申请号：US14353811

申请日：2011-11-03

申请人： Wenfei Jiang ,  Fan Zhang ,  Zhibo Chen

发明人： Wenfei Jiang ,  Fan Zhang ,  Zhibo Chen

IPC分类号： H04N19/18 ,  H04N19/117 ,  H04N19/82 ,  H04N19/136

CPC分类号： H04N19/86 ,  H04N19/103 ,  H04N19/117 ,  H04N19/124 ,  H04N19/132 ,  H04N19/14 ,  H04N19/147 ,  H04N19/176 ,  H04N19/192 ,  H04N19/82

摘要： A particular implementation forms an initial reconstructed image block from inverse quantization and inverse transform, and further refines the reconstructed image block using pixels from neighboring reconstructed blocks. The image block may be refined using a bilateral filter, whose space parameter and range parameter are adaptive to the quantization parameter. The particular implementation can be used in both encoding and decoding when reconstructing an image block. When used in encoding, the particular implementation can be used jointly with coefficient truncation, where some non-zero transform coefficients are set to zero. The number of remaining non-zero transform coefficients after coefficient truncation may be adaptive to the quantization parameter, the variance of the image block, the number of non-zero transform coefficients of the image block, and the index of the last non-zero transform coefficient in a zigzag scanning order.

摘要翻译： 特定的实施方式从反量化和逆变换形成初始重建图像块，并且使用来自相邻重建块的像素进一步精化重构图像块。 可以使用双边滤波器对图像块进行精细化，该双边滤波器的空间参数和范围参数适应量化参数。 在重构图像块时，特定的实施方式可用于编码和解码两者。 当用于编码时，特定的实现可以与系数截断一起使用，其中一些非零变换系数被设置为零。 系数截断后剩余的非零变换系数的数量可以适应于量化参数，图像块的方差，图像块的非零变换系数的数量以及最后的非零变换的索引 系数为锯齿形扫描顺序。

公开(公告)号：US20140037223A1

公开(公告)日：2014-02-06

申请号：US14113005

申请日：2011-04-22

申请人： Wenfei Jiang ,  Zhibo Chen ,  Fan Zhang

发明人： Wenfei Jiang ,  Zhibo Chen ,  Fan Zhang

IPC分类号： H04N7/32 ,  H04N7/30

CPC分类号： H04N19/50 ,  H04N19/124 ,  H04N19/132 ,  H04N19/147 ,  H04N19/18 ,  H04N19/467 ,  H04N19/60 ,  H04N19/86

摘要： The invention proposes modification of quantized coefficients for signalling of a post-processing method. Therefore, it is proposed a method for lossy compress-encoding data comprising at least one of image data and audio data. Said method comprises determining quantized coefficients using a quantization of a discrete cosine transformed residual of a prediction of said data. Said method further comprises modifying said quantized coefficients for minimizing rate-distortion cost wherein distortion is determined using a post-processed reconstruction of the data, the post-processed reconstruction being post-processed according to a post processing method, and compress-encoding said modified coefficients. In said proposed method, the post-processing method is that one of n>1 different predetermined post processing method candidates whose position in an predetermined order of arrangement of the post processing method candidates equals a remainder of division, by n, of a sum of the modified coefficients. Doing so removes the overhead of flags in the bit stream.

摘要翻译： 本发明提出了对后处理方法的信令的量化系数的修改。 因此，提出了一种包括图像数据和音频数据中的至少一个的有损压缩编码数据的方法。 所述方法包括使用所述数据的预测的离散余弦变换残差的量化来确定量化系数。 所述方法还包括修改所述量化系数以最小化速率失真成本，其中使用所述数据的后处理重构来确定失真，所述后处理重建根据后处理方法进行后处理，并且对所述修改 系数。 在所述提出的方法中，后处理方法是以后处理方法候补的预定排列顺序的位置等于n除以n的余数的n≥1个不同的预定后处理方法候选中的一个， 修正系数。 这样做会消除位流中标志的开销。

公开(公告)号：US09672636B2

公开(公告)日：2017-06-06

申请号：US14358289

申请日：2012-04-23

申请人： Fan Zhang ,  Kai Xie ,  Wenfei Jiang ,  Zhibo Chen

发明人： Fan Zhang ,  Kai Xie ,  Wenfei Jiang ,  Zhibo Chen

IPC分类号： G06T7/40 ,  G06T7/00 ,  H04N19/154 ,  H04N19/172 ,  H04N19/117 ,  H04N19/14 ,  H04N19/86 ,  G06T7/13 ,  G06T7/44 ,  H04N19/162

CPC分类号： G06T7/40 ,  G06T7/0002 ,  G06T7/13 ,  G06T7/44 ,  G06T2207/10016 ,  G06T2207/20028 ,  G06T2207/30168 ,  H04N19/117 ,  H04N19/14 ,  H04N19/154 ,  H04N19/162 ,  H04N19/172 ,  H04N19/865

摘要： A particular implementation decomposes an image into a structure component and a texture component. An edge strength map is calculated for the structure component, and a texture strength map is calculated for the texture component. Using the edge strength and the texture strength, texture masking weights are calculated. The stronger the texture strength is, or the weaker the edge strength is, the more distortion can be tolerated by human eyes, and thus, the smaller the texture masking weight is. The local distortions are then weighted by the texture masking weights to generate an overall distortion level or an overall quality metric.

公开(公告)号：US20150117763A1

公开(公告)日：2015-04-30

申请号：US14394626

申请日：2012-05-31

申请人： Fan Zhang ,  Zhibo Chen ,  Wenfei Jiang

发明人： Fan Zhang ,  Zhibo Chen ,  Wenfei Jiang

IPC分类号： G06T7/00 ,  G06K9/66 ,  G06T3/40

CPC分类号： G06T7/0002 ,  G06K9/66 ,  G06T3/4084 ,  G06T2207/20048 ,  G06T2207/30168

摘要： A method and system for determining a quality metric score for image processing are described including accepting a reference image, performing a pyramid transformation on the accepted reference image to produce a predetermined number of scales, applying image division to each scale to produce reference image patches, accepting a distorted image, performing a pyramid transformation on the accepted distorted image to produce the predetermined number of scales, applying image division to each scale to produce distorted image patches, performing a local distortion calculation for corresponding reference and distorted image patches, summing local distortion calculation results for image patch pairs, multiplying results of the summation operation by a positive weight for each scale, summing the results of the multiplication operation and applying a sigmoid function to results of the second summation operation to produce the quality metric score.

摘要翻译： 描述了用于确定用于图像处理的质量度量得分的方法和系统，包括接受参考图像，对所接受的参考图像执行金字塔变换以产生预定数量的刻度，对每个比例应用图像划分以产生参考图像块， 接受失真的图像，对接受的畸变图像执行金字塔变换以产生预定数量的刻度，对每个刻度进行图像划分以产生失真的图像块，对相应的参考和失真的图像块执行局部失真计算，求和局部失真 图像补丁对的计算结果，将求和运算的结果乘以每个比例的正权重，将乘法运算的结果相加，并将S形函数应用于第二加和运算的结果以产生质量度量得分。

公开(公告)号：US10110893B2

公开(公告)日：2018-10-23

申请号：US14343047

申请日：2011-09-09

申请人： Xiao Dong Gu ,  Fan Zhang ,  Zhibo Chen

发明人： Xiao Dong Gu ,  Fan Zhang ,  Zhibo Chen

IPC分类号： H04N19/00 ,  H04N19/86 ,  H04N19/154

摘要： In video quality control and estimation, the joint evaluation of compression artifacts and channel artifacts is a problem. The invention considers the joint perception of both a compression artifact level Dm(V) and a channel artifact level Dh(V) in a method for calculating overall distortion in a video being affected by compression artifacts and channel artifacts. The method comprises a step of adding a compression artifact level Dm(V) and a summand S that is derived from log (Dh(V)) multiplied with a factor that decreases with increasing compression artifact level Dm, such as D(V)=Dm(V)+c·(K−Dm(V))·log(Dh(V)). The result obtained is a measure for the overall distortion.

公开(公告)号：US20150304709A1

公开(公告)日：2015-10-22

申请号：US14443841

申请日：2012-11-30

申请人： Qian ZHANG ,  Ning LIAO ,  Fan ZHANG ,  Zhibo CHEN

发明人： Qian Zhang ,  Ning Liao ,  Fan Zhang ,  Zhibo Chen

IPC分类号： H04N21/44 ,  H04N21/61 ,  H04N21/647 ,  H04N21/643 ,  H04N21/442 ,  H04N21/234

CPC分类号： H04N21/44008 ,  H04N21/23418 ,  H04N21/44209 ,  H04N21/4425 ,  H04N21/6125 ,  H04N21/64322 ,  H04N21/6473 ,  H04N21/64738 ,  H04N21/64769

摘要： A method and apparatus are disclosed for predicting subjective quality of a video contained in a bit stream on a packet layer. Header information of the bit-stream is parsed and frame layer information, such as frame type, is estimated. Visible artifact levels are then estimated based on frame layer information. An overall artifact level and quality metric are estimated based on artifact levels for individual frames with other parameters. Specifically, different weighting factors are used for different frame types when estimating the levels of initial visible artifacts and propagated visible artifacts. The number of slices per frame is used as a parameter when estimating the overall artifact level for the video. Moreover, the quality assessment model considers quality loss caused by both coding and channel artifacts.

摘要翻译： 公开了一种用于预测分组层中的比特流中包含的视频的主观质量的方法和装置。 解析比特流的报头信息，并估计帧类信息，如帧类型。 然后基于帧层信息来估计可见的伪像级别。 基于具有其他参数的单个帧的伪像级别来估计整体神器级别和质量度量。 具体来说，当估计初始可见伪像和传播的可见伪像的水平时，不同的加权因子被用于不同的帧类型。 当估计视频的整体神器级别时，每帧的片数被用作参数。 此外，质量评估模型考虑了由编码和通道伪影引起的质量损失。

公开(公告)号：US20140301486A1

公开(公告)日：2014-10-09

申请号：US14355975

申请日：2011-11-25

申请人： Ning Liao ,  Zhibo Chen ,  Fan Zhang ,  Kai Xie

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang ,  Kai Xie

IPC分类号： H04N19/86 ,  H04N19/89 ,  H04N19/87

CPC分类号： H04N19/48 ,  H04N19/154 ,  H04N19/87 ,  H04N19/895

摘要： A particular implementation detects scene cut artifacts in a bitstream without reconstructing the video. A scene cut artifact is usually observed in the decoded video (1) when a scene cut picture in the original video is partially received or (2) when a picture refers to a lost scene cut picture in the original video. To detect scene cut artifacts, candidate scene cut pictures are first selected and scene cut artifact detection is then performed on the candidate pictures. When a block is determined to have a scene cut artifact, a lowest quality level is assigned to the block.

摘要翻译： 特定的实现检测比特流中的场景切割伪像，而不重建视频。 通常在解码视频（1）中观察到原始视频中的场景切换图像被部分接收或（2）当图片参考原始视频中的丢失的场景切换图像时，场景切割伪影。 为了检测场景切割伪像，首先选择候选场景切割图像，然后对候选图像执行场景切割伪影检测。 当确定块具有场景切割伪影时，将最低质量级别分配给块。

公开(公告)号：US20140286441A1

公开(公告)日：2014-09-25

申请号：US14353351

申请日：2011-11-24

申请人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

发明人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

IPC分类号： H04N19/89

CPC分类号： H04N19/00933 ,  H04N17/004 ,  H04N19/895

摘要： A particular implementation receives a bitstream and derives parameters from the bitstream. The parameters include quantization parameters, content unpredictability parameters, ratios of lost blocks, ratios of propagated blocks, error concealment distances, motion vectors, durations of freezing, and frame rates. Using these parameters, a compression distortion factor, a slicing distortion factor, and a freezing distortion factor are estimated respectively for distortions resulting from video compression, a slicing mode error concealment, and a freezing slicing mode error concealment. The distortion factors are then mapped to a composite video quality score. For applications with limited computational power, the estimation of distortion factors can be simplified. In particular, the compression distortion factor, the slicing distortion factor, and the freezing distortion factor can be predicted from quantization parameters, ratios of lost blocks, and durations of freezing, respectively.

摘要翻译： 特定实现接收比特流并从比特流导出参数。 参数包括量化参数，内容不可预测性参数，丢失块的比率，传播块的比率，错误隐藏距离，运动向量，冻结持续时间和帧速率。 分别使用这些参数来估计压缩失真因子，切片失真因子和冻结失真因子，用于由视频压缩，切片模式错误隐藏和冷冻切片模式错误隐藏产生的失真。 然后将失真因子映射到复合视频质量得分。 对于具有有限计算能力的应用，可以简化失真因子的估计。 具体地，压缩失真因子，切片失真因子和冻结失真因子可以分别从量化参数，丢失块的比率和冻结时间预测。