公开(公告)号：US09420291B2

公开(公告)日：2016-08-16

申请号：US13576848

申请日：2011-02-01

申请人： Dong-Qing Zhang ,  Joan Llach ,  Sitaram Bhagavathy

发明人： Dong-Qing Zhang ,  Joan Llach ,  Sitaram Bhagavathy

IPC分类号： H04N7/12 ,  H04N19/105 ,  G06T1/00 ,  H04N19/139 ,  H04N19/593 ,  H04N19/14 ,  H04N19/94 ,  H04N19/59

CPC分类号： H04N19/105 ,  G06T1/00 ,  H04N19/139 ,  H04N19/14 ,  H04N19/59 ,  H04N19/593 ,  H04N19/94

摘要： Methods and apparatus are provided for reducing vector quantization error through patch shifting. A method generates, from an input video sequence, one of more high resolution replacement patches, the one or more high resolution replacement patches for replacing one or more low resolution patches during a reconstruction of the input video sequence. This generating step generates the one or more high resolution replacement patches using data corresponding to a patch spatial shifting process, the patch spatial shifting process for reducing jittery artifacts caused by a motion-induced vector quantization error in the one or more high resolution replacement patches, the data for at least deriving a patch size of the one or more high resolution replacement patches such that the one or more high resolution replacement patches are generated to have the patch size greater than a patch size of the one or more low resolution patches in order to be suitable for use in the patch spatial shifting process.

摘要翻译： 提供了通过补片移位来减少矢量量化误差的方法和装置。 一种方法从输入视频序列生成更多高分辨率替换贴片之一，该一个或多个高分辨率替换贴片用于在重建输入视频序列期间替换一个或多个低分辨率贴片。 该生成步骤使用与贴片空间移位处理对应的数据来生成一个或多个高分辨率替换贴片，该贴片空间移位处理用于减少由一个或多个高分辨率替换贴片中的运动引起的矢量量化误差引起的抖动伪像， 所述数据用于至少导出所述一个或多个高分辨率替换补丁的补丁大小，使得生成所述一个或多个高分辨率替换补丁以使所述补丁大小大于所述一个或多个低分辨率补丁的补丁大小顺序 适用于贴片空间位移过程。

公开(公告)号：US09338477B2

公开(公告)日：2016-05-10

申请号：US13821424

申请日：2011-09-09

申请人： Dong-Qing Zhang ,  Sitaram Bhagavathy ,  Shan He

发明人： Dong-Qing Zhang ,  Sitaram Bhagavathy ,  Shan He

IPC分类号： G06K9/36 ,  H04N19/85 ,  G06T5/00 ,  H04N19/176 ,  H04N19/46 ,  H04N19/196 ,  H04N19/61 ,  H04N19/593 ,  H04N19/463 ,  H04N19/132 ,  H04N19/14 ,  H04N19/44 ,  H04N19/587 ,  H04N19/97 ,  H04N19/59

CPC分类号： H04N19/85 ,  G06T5/001 ,  H04N19/132 ,  H04N19/14 ,  H04N19/176 ,  H04N19/196 ,  H04N19/44 ,  H04N19/46 ,  H04N19/463 ,  H04N19/587 ,  H04N19/59 ,  H04N19/593 ,  H04N19/61 ,  H04N19/97

摘要： Method and apparatus for recovering a pruned version of a picture in a video sequence are disclosed. The apparatus includes a divider for dividing the pruned version of the picture into a plurality of non-overlapping blocks. The apparatus also includes a metadata decoder for decoding metadata for use in recovering the pruned version of the picture. The apparatus further includes a patch library creator for creating a patch library from a reconstructed version of the picture. The patch library includes a plurality of high resolution replacement patches for replacing the one or more pruned blocks during a recovery of the pruned version of the picture. The apparatus additionally includes a search and replacement device for performing a searching process using the metadata to find a corresponding patch for a respective one of the one or more pruned blocks from among the plurality of non-overlapping blocks and replace the respective one of the one or more pruned blocks with the corresponding patch. The signature is respectively created for each of the one or more pruned blocks, and the pruned version of the picture is recovered by comparing respective distance metrics from signatures for each of the plurality of high resolution patches to signatures for each of the one or more pruned blocks, sorting the respective distance metrics to obtain a rank list for each of the one or more pruned blocks, wherein a rank number in the rank list for a particular one of the one or more pruned blocks is used to retrieve a corresponding one of the plurality of high resolution patches in the patch library to be used to replace the particular one of the one or more pruned blocks. A patch dependency graph having a plurality of nodes and a plurality of edges is used to recover the pruned version of the picture. Each of the plurality of nodes represents a respective one of the plurality of overlapping blocks, and each of the plurality of edges represents a respective dependency of at least the respective one of the plurality of overlapping blocks.

公开(公告)号：US09143776B2

公开(公告)日：2015-09-22

申请号：US13465806

申请日：2012-05-07

申请人： Yifu Zhang ,  Dong-Qing Zhang ,  Hong Yu

发明人： Yifu Zhang ,  Dong-Qing Zhang ,  Hong Yu

IPC分类号： H04N7/12 ,  H04N17/02

CPC分类号： H04N17/02

摘要： Techniques for objectively determining perceived video/image quality, the techniques including receiving a degraded bit-stream comprising encoded video/image data, and subsequently parsing the bit-stream to extract one or more video/image coding components. The video coding components may include intra-prediction modes, discrete cosine transform (DCT) coefficients, motion information, or combinations thereof, and may be used as a basis for objectively predicting a Quality of Experience (QoE) or Motion Opinion Score (MOS) score of the degraded bit-stream.

摘要翻译： 用于客观地确定感知的视频/图像质量的技术，所述技术包括接收包括经编码的视频/图像数据的退化位流，并且随后解析比特流以提取一个或多个视频/图像编码组件。 视频编码组件可以包括帧内预测模式，离散余弦变换（DCT）系数，运动信息或其组合，并且可以用作客观地预测体验质量（QoE）或运动视点得分（MOS） 劣化比特流的得分。

公开(公告)号：US09020259B2

公开(公告)日：2015-04-28

申请号：US13383626

申请日：2010-07-19

申请人： Sitaram Bhagavathy ,  Dong-Qing Zhang

发明人： Sitaram Bhagavathy ,  Dong-Qing Zhang

IPC分类号： G06K9/00 ,  G06T5/00

CPC分类号： G06K9/00711 ,  G06K9/00684 ,  G06K9/00724 ,  G06T5/00 ,  G06T2207/10016 ,  G06T2207/20004 ,  G06T2207/30228

摘要： A method is disclosed for analyzing video to detect far-view scenes in sports video to determine when certain image processing algorithms should be applied. The method comprises analyzing and classifying the fields of view of images from a video signal, creating and classifying the fields of view of sets of sequential images, and selectively applying image processing algorithms to sets of sequential images representing a particular type of field of view.

摘要翻译： 公开了一种用于分析视频以检测运动视频中的远景场景的方法，以确定何时应用某些图像处理算法。 该方法包括从视频信号中分析和分类图像的视场，创建和分类连续图像集合的视场，以及选择性地将图像处理算法应用于表示特定类型的视场的连续图像的集合。

公开(公告)号：US08768089B2

公开(公告)日：2014-07-01

申请号：US13429161

申请日：2012-03-23

申请人： Dong-Qing Zhang

发明人： Dong-Qing Zhang

IPC分类号： G06K9/40

CPC分类号： H04N19/86 ,  H04N19/117 ,  H04N19/14 ,  H04N19/154 ,  H04N19/176 ,  H04N19/40

摘要： An embodiment is configured to calculate a perceptual masking factor at a pixel location at a block boundary of the image, calculate a parameter for a filter at the pixel location at the block boundary, and filter the image around the pixel location at the block boundary employing the filter with the calculated parameter. The perceptual masking factor is formed as a product of a background activity masking map and a luminance masking map. The filter includes a parameter that is selected in view of a quality of experience performance measure for the image at the pixel location at the block boundary of the image.

摘要翻译： 一个实施例被配置为计算在图像的块边界处的像素位置处的感知屏蔽因子，计算在块边界处的像素位置处的滤波器的参数，并且在采用的块边界处对像素位置周围的图像进行滤波 该过滤器具有计算参数。 感知掩蔽因子形成为背景活动掩蔽图和亮度掩蔽图的乘积。 滤波器包括从图像块边界处的像素位置处的图像的经验性能测量的质量来选择的参数。

公开(公告)号：US20130163676A1

公开(公告)日：2013-06-27

申请号：US13821078

申请日：2011-09-09

申请人： Dong-Qing Zhang ,  Mithun George Jacob ,  Sitaram Bhagavathy

发明人： Dong-Qing Zhang ,  Mithun George Jacob ,  Sitaram Bhagavathy

IPC分类号： H04N7/26

CPC分类号： H04N19/85 ,  H04N19/132 ,  H04N19/14 ,  H04N19/176 ,  H04N19/44 ,  H04N19/46 ,  H04N19/587 ,  H04N19/61

摘要： Methods and apparatus are provided for decoding video signals using motion compensated example-based super-resolution for video compression. An apparatus includes an example-based super-resolution processor for receiving one or more high resolution replacement patch pictures generated from a static version of an input video sequence having motion, and performing example-based super-resolution to generate a reconstructed version of the static version of the input video sequence from the one or more high resolution replacement patch pictures. The reconstructed version of the static version of the input video sequence includes a plurality of pictures. The apparatus further includes an inverse image warper for receiving motion parameters for the input video sequence, and performing an inverse picture warping process based on the motion parameters to transform one or more of the plurality of pictures to generate a reconstruction of the input video sequence having the motion.

摘要翻译： 提供了使用用于视频压缩的基于运动补偿的基于示例的超分辨率来解码视频信号的方法和装置。 一种装置包括基于示例的超分辨率处理器，用于接收从具有运动的输入视频序列的静态版本生成的一个或多个高分辨率替换贴片图像，并且执行基于示例的超分辨率以生成静态的重建版本 版本的输入视频序列从一个或多个高分辨率替换补丁图片。 输入视频序列的静态版本的重建版本包括多个图片。 所述装置还包括用于接收所述输入视频序列的运动参数的逆图像整形器，以及基于所述运动参数执行逆图像扭曲处理，以转换所述多个图像中的一个或多个图像，以产生具有 动议。

公开(公告)号：US20130163674A1

公开(公告)日：2013-06-27

申请号：US13821130

申请日：2011-09-09

申请人： Dong-Qing Zhang

发明人： Dong-Qing Zhang

IPC分类号： H04N7/26

CPC分类号： H04N19/105 ,  H04N19/13 ,  H04N19/147 ,  H04N19/176 ,  H04N19/44 ,  H04N19/46 ,  H04N19/51 ,  H04N19/593 ,  H04N19/60 ,  H04N19/61 ,  H04N19/615 ,  H04N19/91

摘要： Method and apparatus are provided for efficient reference data encoding for video compression by image content based search and ranking. An apparatus includes a rank transformer for respectively transforming reference data for each of a plurality of candidate reference blocks with respect to a current block to be encoded into a respective rank number there for based on a context feature of the current block with respect to the context feature of each of the plurality of candidate reference blocks. The apparatus further includes an entropy encoder for respectively entropy encoding the respective rank number for each of the plurality of candidate reference blocks with respect to the current block in place of, and representative of, the reference data for each of the plurality of candidate reference blocks with respect to the current block.

摘要翻译： 提供了通过基于图像内容的搜索和排名的用于视频压缩的有效参考数据编码的方法和装置。 一种装置包括等级变换器，用于基于当前块相对于上下文的上下文特征，将关于待编码的当前块的参考数据分别变换为其中的相应等级数，将参考数据分别变换为多个候选参考块 多个候选参考块中的每一个的特征。 该装置还包括一个熵编码器，用于相对于当前块分别熵编码多个候选参考块中的每个候选参考块的相应等级号，并代表多个候选参考块中的每一个的参考数据 相对于当前块。

公开(公告)号：US20130163661A1

公开(公告)日：2013-06-27

申请号：US13821257

申请日：2011-09-09

申请人： Dong-Qing Zhang ,  Sitaram Bhagavathy

发明人： Dong-Qing Zhang ,  Sitaram Bhagavathy

IPC分类号： H04N7/26

CPC分类号： H04N19/85 ,  H04N19/132 ,  H04N19/14 ,  H04N19/176 ,  H04N19/44 ,  H04N19/46 ,  H04N19/587 ,  H04N19/61

摘要： Methods and apparatus are provided for encoding video signals using example-based data pruning for improved video compression efficiency. An apparatus for encoding a picture in a video sequence includes a patch library creator for creating a first patch library from an original version of the picture and a second patch library from a reconstructed version of the picture. Each of the first patch library and the second patch library includes a plurality of high resolution replacement patches for replacing one or more pruned blocks during a recovery of a pruned version of the picture. The apparatus also includes a pruner for generating the pruned version of the picture from the first patch library, and a metadata generator for generating metadata from the second patch library. The metadata is for recovering the pruned version of the picture. The apparatus further includes an encoder for encoding the pruned version of the picture and the metadata.

摘要翻译： 提供了使用基于示例的数据修剪来编码视频信号以提高视频压缩效率的方法和装置。 用于对视频序列中的图像进行编码的装置包括补丁库创建器，用于从图像的原始版本创建第一补丁库，以及从图像的重建版本生成第二补丁库。 第一补丁库和第二补丁库中的每个包括多个高分辨率替换补丁，用于在恢复修剪版本的图片期间替换一个或多个修剪块。 该装置还包括修剪器，用于从第一补丁库生成图像的修剪版本，以及用于从第二补丁库生成元数据的元数据生成器。 元数据用于恢复图像的修剪版本。 该装置还包括用于编码图像的修剪版本和元数据的编码器。

公开(公告)号：US08355079B2

公开(公告)日：2013-01-15

申请号：US12658264

申请日：2010-02-09

申请人： Dong-Qing Zhang ,  Sitaram Bhagavathy

发明人： Dong-Qing Zhang ,  Sitaram Bhagavathy

IPC分类号： H04N11/00 ,  H04N7/00

CPC分类号： G06K9/3266

摘要： A caption detection system wherein all detected caption boxes over time for one caption area are identical, thereby reducing temporal instability and inconsistency. This is achieved by grouping candidate pixels in the 3D spatiotemporal space and generating a 3D bounding box for one caption area. 2D bounding boxes are obtained by slicing the 3D bounding boxes, thereby reducing temporal instability as all 2D bounding boxes corresponding to a caption area are sliced from one 3D bounding box and are therefore identical over time.

摘要翻译： 字幕检测系统，其中所有检测到的字幕盒随着时间的推移对于一个字幕区域是相同的，从而减少时间不稳定性和不一致性。 这通过在3D时空中分组候选像素并为一个字幕区域生成3D边界框来实现。 通过对3D边界框进行切片来获得2D边界框，从而减少时间不稳定性，因为与一个3D边界框对应的所有2D边界框都被切割，因此随着时间的推移相同。

公开(公告)号：US20120288217A1

公开(公告)日：2012-11-15

申请号：US13574919

申请日：2011-01-25

申请人： Jiefu Zhai ,  Zhe Wang ,  Dong-Qing Zhang

发明人： Jiefu Zhai ,  Zhe Wang ,  Dong-Qing Zhang

IPC分类号： G06T5/50

CPC分类号： H04N5/235 ,  G06T5/50 ,  G06T2200/21 ,  G06T2207/20208 ,  H04N5/2355

摘要： A new high dynamic range image synthesis which can handle the local object motion, wherein an interactive graphical user interface is provided for the end user, through which one can specify the source image for separate part of the final high dynamic range image, either by creating a image mask or scribble on the image. The high dynamic range image synthesis includes the following steps: capturing low dynamic range images with different exposures; registering the low dynamic range images; estimating camera response function; converting the low dynamic range images to temporary radiance images using estimated camera response function; and fusing the temporary radiance images into a single high dynamic range (HDR) image by employing a method of layered masking.

摘要翻译： 可以处理局部对象运动的新的高动态范围图像合成，其中为最终用户提供交互式图形用户界面，通过该动态范围图像可以为最终的高动态范围图像的分离部分指定源图像，通过创建 图像掩码或图像上的涂鸦。 高动态范围图像合成包括以下步骤：捕获具有不同曝光的低动态范围图像; 注册低动态范围图像; 估计摄像机响应功能; 使用估计的相机响应函数将低动态范围图像转换成临时辐射图像; 并通过采用分层掩蔽的方法将临时辐射图像融合到单个高动态范围（HDR）图像中。