公开(公告)号：US09549183B2

公开(公告)日：2017-01-17

申请号：US14116342

申请日：2011-05-12

申请人： Ning Liao ,  Xiao Dong Gu ,  Zhibo Chen ,  Kai Xie

发明人： Ning Liao ,  Xiao Dong Gu ,  Zhibo Chen ,  Kai Xie

IPC分类号： H04N19/107 ,  H04N19/89 ,  H04N19/513 ,  H04N19/154 ,  H04N19/895

CPC分类号： H04N19/513 ,  H04N19/107 ,  H04N19/154 ,  H04N19/895

摘要： A method for estimating video quality on bit-stream level, wherein the video quality refers to a video after error concealment and the method is performed on bit-stream level before said error concealment, comprises extracting and/or calculating a plurality of global condition features from a video bit-stream, extracting and/or calculating a plurality of local effectiveness features at least for a lost MB, calculating a numeric error concealment effectiveness level for each (or at least for each lost) MB by emulating an error concealment method that is used in said error concealment, and providing the calculated error concealment effectiveness level as an estimated visible artifacts level of video quality.

摘要翻译： 一种用于估计比特流级别的视频质量的方法，其中所述视频质量是指在错误隐藏之后的视频，并且所述方法在所述错误隐藏之前的比特流级别上执行，包括提取和/或计算多个全局条件特征 至少对于丢失MB提取和/或计算多个局部有效特征，通过模拟错误隐藏方法（或至少对于每个丢失的）MB来计算数字错误隐藏有效性级别 用于所述错误隐藏，并将计算出的错误隐藏有效性级别提供为视频质量的估计可见伪像级别。

公开(公告)号：US20140119460A1

公开(公告)日：2014-05-01

申请号：US14128623

申请日：2011-06-24

申请人： Xiao Dong Gu ,  Ning Liao ,  Zhibo Chen

发明人： Xiao Dong Gu ,  Ning Liao ,  Zhibo Chen

IPC分类号： H04N19/89

CPC分类号： H04N19/89 ,  H04N19/154

摘要： Because of the encoding, decoding, and/or transmitting characteristic, the blocks affected by packet defect usually gather in a small spatial/temporal area. The viewers perception of each affected block will influence by other affected block in this small area. The invention proposes using processing means for clustering blocks affected by the packet loss into at least one cluster, for using at least one of spatial and temporal characteristics of the at least one cluster for determining a visibility value of the at least one cluster, for classifying the at least one cluster as belonging into one of at least two different class candidates, wherein each class candidate is associated with a different weight; for weighting the determined visibility value with the weight associated with the class of the at least one cluster, and for assessing the degradation of the video using a sum of the weighted visibility value.

摘要翻译： 由于编码，解码和/或发送特性，受分组缺陷影响的块通常聚集在小的空间/时间区域中。 每个受影响区块的观众感知将受到其他受影响区块的影响。 本发明提出使用处理装置，用于将受分组丢失影响的块聚集到至少一个簇中，以便使用至少一个簇的空间和时间特征中的至少一个来确定至少一个簇的可见性值，以便分类 所述至少一个集群属于至少两个不同类候选中的一个，其中每个类候选者与不同的权重相关联; 用于利用与所述至少一个集群的类别相关联的权重对所确定的可见性值进行加权，并且使用加权的可见性值的和来评估视频的劣化。

公开(公告)号：US09202269B2

公开(公告)日：2015-12-01

申请号：US14127325

申请日：2011-06-21

申请人： Kai Xie ,  Xiao Dong Gu ,  Zhibo Chen

发明人： Kai Xie ,  Xiao Dong Gu ,  Zhibo Chen

IPC分类号： G06K9/62 ,  G06T7/00 ,  H04N17/00 ,  G06K9/46 ,  H04N21/234 ,  H04N21/25 ,  H04N21/475 ,  H04N21/658 ,  H04L12/24 ,  G06Q30/02

CPC分类号： G06T7/0002 ,  G06K9/46 ,  G06Q30/0278 ,  H04L41/5067 ,  H04N17/004 ,  H04N21/23418 ,  H04N21/251 ,  H04N21/475 ,  H04N21/6582

摘要： A user terminal device, a server device, a system and a method for assessing quality of media data are described. The user terminal device is used for extracting artifact features from the media data and for communicating the features to the server device which is then used for determining a quality score using the artifacts and an artifact/quality score database accessible by the server device. The score, transmitted to the user terminal device, is presented to a user from which a subjective quality score and a request for re-determination are received which the user terminal device communicates to the server device. This in turn is used for re-determining the quality score and for transmitting back the re-determined quality score wherein the quality score is re-determined using the received artifacts, the received subjective quality score and the artifact/quality score database.

摘要翻译： 描述用于评估媒体数据质量的用户终端设备，服务器设备，系统和方法。 用户终端设备用于从媒体数据中提取伪像特征，并将特征传送到服务器设备，然后将服务器设备用于使用伪像和由服务器设备访问的伪影/质量得分数据来确定质量得分。 发送给用户终端设备的分数被呈现给用户，用户终端设备从服务器设备接收到主观质量得分和重新确定请求。 这又用于重新确定质量得分并用于发送回重新确定的质量得分，其中使用接收到的人造物，接收到的主观质量得分和人工/质量得分数据库重新确定质量得分。

公开(公告)号：US20140140612A1

公开(公告)日：2014-05-22

申请号：US14127325

申请日：2011-06-21

申请人： Kai Xie ,  Xiao Dong Gu ,  Zhibo Chen

发明人： Kai Xie ,  Xiao Dong Gu ,  Zhibo Chen

IPC分类号： G06T7/00 ,  G06K9/46

CPC分类号： G06T7/0002 ,  G06K9/46 ,  G06Q30/0278 ,  H04L41/5067 ,  H04N17/004 ,  H04N21/23418 ,  H04N21/251 ,  H04N21/475 ,  H04N21/6582

摘要： A user terminal device, a server device, a system and a method for assessing quality of media data are described. The user terminal device is used for extracting artefact features from the media data and for communicating the features to the server device which is then used for determining a quality score using the artefacts and an artefact/quality score database accessible by the server device. The score, transmitted to the user terminal device, is presented to a user from which a subjective quality score and a request for re-determination are received which the user terminal device communicates to the server device. This in turn is used for re-determining the quality score and for transmitting back the re-determined quality score wherein the quality score is re-determined using the received artefacts, the received subjective quality score and the artefact/quality score database.

摘要翻译： 描述用于评估媒体数据质量的用户终端设备，服务器设备，系统和方法。 用户终端设备用于从媒体数据中提取伪像特征，并用于将特征传送到服务器设备，然后使用该装置来确定质量得分以及由服务器设备访问的伪影/质量得分数据库。 发送给用户终端设备的分数被呈现给用户，用户终端设备从服务器设备接收到主观质量得分和重新确定请求。 这反过来用于重新确定质量得分并用于发送回重新确定的质量得分，其中使用所接收的伪影，接收到的主观质量得分和伪影/质量得分数据库重新确定质量得分。

公开(公告)号：US09769501B2

公开(公告)日：2017-09-19

申请号：US14405079

申请日：2012-07-17

申请人： Ning Liao ,  Zhibo Chen ,  Kai Xie

发明人： Ning Liao ,  Zhibo Chen ,  Kai Xie

IPC分类号： H04N19/895 ,  H04N19/44 ,  H04N19/184 ,  H04N19/139 ,  H04N19/177 ,  H04N17/00 ,  H04N19/86 ,  H04N19/89 ,  H04N19/154

CPC分类号： H04N19/895 ,  H04N17/004 ,  H04N19/139 ,  H04N19/154 ,  H04N19/177 ,  H04N19/184 ,  H04N19/44 ,  H04N19/86 ,  H04N19/89

摘要： A macroblock in a video sequence may be undecodable because the corresponding compressed data is lost or the syntax is out of synchronization. An undecodable macroblock may be concealed using error concealment technique. The level of initial visible artifacts caused by undecodable macroblocks may be estimated as a function of motion magnitude, error concealment distance, and/or residual energy. The initial visible artifacts may propagate spatially or temporally to other macroblocks through prediction. Considering both initial visible artifacts and propagated artifacts, levels of overall artifacts may be estimated for individual macroblocks. The visual quality for the video sequence can then be estimated by pooling the macroblock level artifact levels.

公开(公告)号：US20150215619A1

公开(公告)日：2015-07-30

申请号：US14423325

申请日：2012-12-29

申请人： Ning Liao ,  Zhibo Chen ,  Kai Xie

发明人： Ning Liao ,  Zhibo Chen ,  Kai Xie

IPC分类号： H04N19/109 ,  H04N19/176 ,  H04N19/182 ,  H04N19/154 ,  H04N19/142 ,  H04N19/184

CPC分类号： H04N19/109 ,  H04N5/147 ,  H04N17/004 ,  H04N19/11 ,  H04N19/142 ,  H04N19/154 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/48

摘要： The invention provides a method and apparatus for detecting a gradual transition picture in a bitstream. The method comprises: accessing a bitstream including encoded pictures; and determining a gradual transition picture in the bitstream using information from the bitstream without decoding the bitstream to derive pixel information.

摘要翻译： 本发明提供一种用于检测比特流中的逐渐转换图像的方法和装置。 该方法包括：访问包括编码图像的比特流; 以及使用来自所述比特流的信息确定所述比特流中的逐渐转换图像，而不解码所述比特流以导出像素信息。

公开(公告)号：US10075710B2

公开(公告)日：2018-09-11

申请号：US14353351

申请日：2011-11-24

申请人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

发明人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

IPC分类号： H04N19/89 ,  H04N17/00 ,  H04N19/895

CPC分类号： H04N19/176 ,  H04N17/004 ,  H04N19/895

摘要： A particular implementation receives a bitstream and derives parameters from the bitstream. The parameters include quantization parameters, content unpredictability parameters, ratios of lost blocks, ratios of propagated blocks, error concealment distances, motion vectors, durations of freezing, and frame rates. Using these parameters, a compression distortion factor, a slicing distortion factor, and a freezing distortion factor are estimated respectively for distortions resulting from video compression, a slicing mode error concealment, and a freezing slicing mode error concealment. The distortion factors are then mapped to a composite video quality score. For applications with limited computational power, the estimation of distortion factors can be simplified. In particular, the compression distortion factor, the slicing distortion factor, and the freezing distortion factor can be predicted from quantization parameters, ratios of lost blocks, and durations of freezing, respectively.

公开(公告)号：US09961340B2

公开(公告)日：2018-05-01

申请号：US14364144

申请日：2011-12-15

申请人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

发明人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

IPC分类号： H04N7/12 ,  H04N17/00 ,  H04N19/176 ,  H04N19/124 ,  H04N19/154

CPC分类号： H04N17/004 ,  H04N19/124 ,  H04N19/154 ,  H04N19/176

摘要： Accuracy and efficiency of video quality measurement are major problems to be solved. According to the invention, a method for accurately predicting video quality uses a rational function of the quantization parameter QP, which is corrected by a correction function that depends on content unpredictability CU. Exemplarily, the correction function is a power function of the CU. Both QP and CU can be computed from the video elementary stream, without full decoding the video. This ensures high efficiency.

公开(公告)号：US20140301486A1

公开(公告)日：2014-10-09

申请号：US14355975

申请日：2011-11-25

申请人： Ning Liao ,  Zhibo Chen ,  Fan Zhang ,  Kai Xie

发明人： Ning Liao ,  Zhibo Chen ,  Fan Zhang ,  Kai Xie

IPC分类号： H04N19/86 ,  H04N19/89 ,  H04N19/87

CPC分类号： H04N19/48 ,  H04N19/154 ,  H04N19/87 ,  H04N19/895

摘要： A particular implementation detects scene cut artifacts in a bitstream without reconstructing the video. A scene cut artifact is usually observed in the decoded video (1) when a scene cut picture in the original video is partially received or (2) when a picture refers to a lost scene cut picture in the original video. To detect scene cut artifacts, candidate scene cut pictures are first selected and scene cut artifact detection is then performed on the candidate pictures. When a block is determined to have a scene cut artifact, a lowest quality level is assigned to the block.

摘要翻译： 特定的实现检测比特流中的场景切割伪像，而不重建视频。 通常在解码视频（1）中观察到原始视频中的场景切换图像被部分接收或（2）当图片参考原始视频中的丢失的场景切换图像时，场景切割伪影。 为了检测场景切割伪像，首先选择候选场景切割图像，然后对候选图像执行场景切割伪影检测。 当确定块具有场景切割伪影时，将最低质量级别分配给块。

公开(公告)号：US20140286441A1

公开(公告)日：2014-09-25

申请号：US14353351

申请日：2011-11-24

申请人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

发明人： Fan Zhang ,  Ning Liao ,  Kai Xie ,  Zhibo Chen

IPC分类号： H04N19/89

CPC分类号： H04N19/00933 ,  H04N17/004 ,  H04N19/895

摘要： A particular implementation receives a bitstream and derives parameters from the bitstream. The parameters include quantization parameters, content unpredictability parameters, ratios of lost blocks, ratios of propagated blocks, error concealment distances, motion vectors, durations of freezing, and frame rates. Using these parameters, a compression distortion factor, a slicing distortion factor, and a freezing distortion factor are estimated respectively for distortions resulting from video compression, a slicing mode error concealment, and a freezing slicing mode error concealment. The distortion factors are then mapped to a composite video quality score. For applications with limited computational power, the estimation of distortion factors can be simplified. In particular, the compression distortion factor, the slicing distortion factor, and the freezing distortion factor can be predicted from quantization parameters, ratios of lost blocks, and durations of freezing, respectively.

摘要翻译： 特定实现接收比特流并从比特流导出参数。 参数包括量化参数，内容不可预测性参数，丢失块的比率，传播块的比率，错误隐藏距离，运动向量，冻结持续时间和帧速率。 分别使用这些参数来估计压缩失真因子，切片失真因子和冻结失真因子，用于由视频压缩，切片模式错误隐藏和冷冻切片模式错误隐藏产生的失真。 然后将失真因子映射到复合视频质量得分。 对于具有有限计算能力的应用，可以简化失真因子的估计。 具体地，压缩失真因子，切片失真因子和冻结失真因子可以分别从量化参数，丢失块的比率和冻结时间预测。