公开(公告)号：US20130293725A1

公开(公告)日：2013-11-07

申请号：US13465806

申请日：2012-05-07

Applicant: Yifu Zhang ,  Dong-Qing Zhang ,  Hong Yu

Inventor： Yifu Zhang ,  Dong-Qing Zhang ,  Hong Yu

IPC: H04N17/00

CPC classification number: H04N17/02

Abstract: Techniques for objectively determining perceived video/image quality, the techniques including receiving a degraded bit-stream comprising encoded video/image data, and subsequently parsing the bit-stream to extract one or more video/image coding components. The video coding components may include intra-prediction modes, discrete cosine transform (DCT) coefficients, motion information, or combinations thereof, and may be used as a basis for objectively predicting a Quality of Experience (QoE) or Motion Opinion Score (MOS) score of the degraded bit-stream.

Abstract translation: 用于客观地确定感知的视频/图像质量的技术，所述技术包括接收包括经编码的视频/图像数据的退化位流，并且随后解析比特流以提取一个或多个视频/图像编码组件。 视频编码组件可以包括帧内预测模式，离散余弦变换（DCT）系数，运动信息或其组合，并且可以用作客观地预测体验质量（QoE）或运动视点得分（MOS） 劣化比特流的得分。

公开(公告)号：US09143776B2

公开(公告)日：2015-09-22

申请号：US13465806

申请日：2012-05-07

Applicant: Yifu Zhang ,  Dong-Qing Zhang ,  Hong Yu

Inventor： Yifu Zhang ,  Dong-Qing Zhang ,  Hong Yu

IPC: H04N7/12 ,  H04N17/02

CPC classification number: H04N17/02

Abstract: Techniques for objectively determining perceived video/image quality, the techniques including receiving a degraded bit-stream comprising encoded video/image data, and subsequently parsing the bit-stream to extract one or more video/image coding components. The video coding components may include intra-prediction modes, discrete cosine transform (DCT) coefficients, motion information, or combinations thereof, and may be used as a basis for objectively predicting a Quality of Experience (QoE) or Motion Opinion Score (MOS) score of the degraded bit-stream.

Abstract translation: 用于客观地确定感知的视频/图像质量的技术，所述技术包括接收包括经编码的视频/图像数据的退化位流，并且随后解析比特流以提取一个或多个视频/图像编码组件。 视频编码组件可以包括帧内预测模式，离散余弦变换（DCT）系数，运动信息或其组合，并且可以用作客观地预测体验质量（QoE）或运动视点得分（MOS） 劣化比特流的得分。

公开(公告)号：US09659382B2

公开(公告)日：2017-05-23

申请号：US12994894

申请日：2008-05-28

Applicant: Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

Inventor： Dong-Qing Zhang ,  Izzat Izzat ,  Youngshik Yoon

IPC: G06T7/593 ,  G06T7/579

CPC classification number: G06T7/593 ,  G06T7/579 ,  G06T2207/10012 ,  G06T2207/10021

Abstract: A system and method for spatiotemporal depth extraction of images with forward and backward depth prediction are provided. The system and method of the present disclosure provide for acquiring a plurality of frames, generating a first depth map of a current frame in the plurality of frames based on a depth map of a previous frame in the plurality of frames, generating a second depth map of the current frame in the plurality of frames based on a depth map of a subsequent frame in the plurality of frames, and processing the first depth map and the second depth map to produce a third depth map for the current frame.

公开(公告)号：US09246830B2

公开(公告)日：2016-01-26

申请号：US13253654

申请日：2011-10-05

Applicant: Zhu Li ,  Yong Wang ,  Dong-Qing Zhang ,  Hong Heather Yu

Inventor： Zhu Li ,  Yong Wang ,  Dong-Qing Zhang ,  Hong Heather Yu

IPC: H04L12/28 ,  H04L12/823 ,  H04L12/835 ,  H04L29/06 ,  H04N21/647

CPC classification number: H04L47/323 ,  H04L47/30 ,  H04L65/80 ,  H04N21/64738 ,  H04N21/64769

Abstract: Methods and systems for a multimedia queue management solution that maintaining graceful Quality of Experience (QoE) degradation are provided. The method selects a frame from all weighted queues based on a gradient function indicating a network performance rate change and a distortion rate caused by the frame and its related frames in the queue, and dropping the selected frame and all its related frames, and continues to drop similarly chosen frame until a network performance rate change caused by the dropping frame and its related frames meets a predetermined performance metric. A frame gradient is a distortion rate divided by a network performance rate change caused by the frame and its related frames, and a distortion rate is based on a sum of each individual frame distortion rate when the frame and its related frames are replaced by some other frames derived from remaining frames based on a replacement method.

Abstract translation: 提供了维护优雅的体验质量（QoE）降级的多媒体队列管理解决方案和方法。 该方法基于指示网络性能速率变化的梯度函数和由帧及其相关帧在队列中引起的失真率，并且丢弃所选帧及其所有相关帧，从所有加权队列中选择一帧，并继续 丢弃类似地选择的帧，直到由丢弃帧及其相关帧引起的网络性能速率变化满足预定的性能度量。 帧梯度是由帧及其相关帧引起的网络性能速率变化除以失真率，并且当帧和其相关帧被其他一些替换时，失真率基于每个单独的帧失真率的和 基于替换方法从剩余帧导出的帧。

公开(公告)号：US09137518B2

公开(公告)日：2015-09-15

申请号：US12735402

申请日：2008-01-29

Applicant: Dong-Qing Zhang ,  Izzat Hekmat Izzat

Inventor： Dong-Qing Zhang ,  Izzat Hekmat Izzat

IPC: H04N15/00 ,  H04N13/00 ,  H04N13/02

CPC classification number: H04N13/261

Abstract: Methods and Systems are provided for converting a two-dimensional image sequence into a three-dimensional image. In one embodiment, a method for converting a two-dimensional image sequence into a three-dimensional image includes determining camera motion parameters between consecutive images in a monoscopic sequence of reference 2D images, wherein the consecutive images comprise a current reference image and an adjacent image, determining a horizontal disparity map for a target image using the camera motion parameters, determining a disparity probability value for each disparity vector of the disparity map, and determining a target image as a weighted average of pixel values in the current reference image using the disparity probability values, such that the target image and current reference image comprise a stereoscopic image pair.

Abstract translation: 提供了将二维图像序列转换为三维图像的方法和系统。 在一个实施例中，将二维图像序列转换成三维图像的方法包括在参考2D图像的单视场序列中确定连续图像之间的相机运动参数，其中连续图像包括当前参考图像和相邻图像 使用相机运动参数确定目标图像的水平视差图，确定视差图的每个视差矢量的视差概率值，以及使用视差来确定目标图像作为当前参考图像中的像素值的加权平均值 概率值，使得目标图像和当前参考图像包括立体图像对。

公开(公告)号：US09118912B2

公开(公告)日：2015-08-25

申请号：US13508562

申请日：2010-12-08

Applicant: Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

Inventor： Sitaram Bhagavathy ,  Joan Llach ,  Dong-Qing Zhang ,  Jesus Barcons-Palau

IPC: H04N7/26 ,  H04N19/103 ,  H04N19/172 ,  H04N19/115 ,  H04N19/14 ,  H04N19/154 ,  H04N19/20 ,  H04N19/176 ,  H04N19/147 ,  H04N19/46 ,  H04N19/124 ,  H04N19/137 ,  H04N19/167 ,  H04N19/85 ,  H04N19/177

CPC classification number: H04N19/103 ,  H04N19/115 ,  H04N19/124 ,  H04N19/137 ,  H04N19/14 ,  H04N19/147 ,  H04N19/154 ,  H04N19/167 ,  H04N19/172 ,  H04N19/176 ,  H04N19/177 ,  H04N19/20 ,  H04N19/46 ,  H04N19/85

Abstract: A method of object-aware video coding is provided that comprises the steps of: receiving a video sequence having a plurality of frames; selecting at least two frames; determing total area of at least one object of interest in each of the at least two frames; comparing the total area to a threshold area; classifying each of the at least two frames as being a low object weighted frame or a high object weighted frame, low object weighted frames being frames having the total area exceeding the threshold area and high object weighted frames being frame having the total area not exceeding the threshold area; and encoding each low object weighted frame according to one encoding mode and encoding each high object weighted frame according to a different encoding mode.

Abstract translation: 提供了一种对象感知视频编码方法，包括以下步骤：接收具有多个帧的视频序列; 选择至少两个帧; 确定所述至少两个帧中的每一个中的至少一个感兴趣对象的总面积; 将总面积与阈值区域进行比较; 将至少两个帧中的每一个分类为低对象加权帧或高对象加权帧，低对象加权帧是具有超过阈值区域的总区域的帧，并且高对象加权帧是具有不超过阈值区域的总区域的帧 阈值面积 并根据一个编码模式对每个低对象加权帧进行编码，并根据不同的编码模式对每个高对象加权帧进行编码。

公开(公告)号：US08619073B2

公开(公告)日：2013-12-31

申请号：US12447029

申请日：2006-10-27

Applicant: Dong-Qing Zhang ,  Ana Belen Benitez ,  James Arthur Fancher

Inventor： Dong-Qing Zhang ,  Ana Belen Benitez ,  James Arthur Fancher

IPC: G06T15/00

CPC classification number: G06T7/50 ,  G06T13/20 ,  G06T2210/56

Abstract: A system and method for recovering three-dimensional (3D) particle systems from two-dimensional (2D) images are provided. The system and method of the present invention provide for identifying a fuzzy object in a two-dimensional (2D) image; selecting a particle system from a plurality of predetermined particle systems, the selected particle system relating to a predefined fuzzy object; generating at least one particle of the selected particle system; simulating the at least one particle to update states of the at least one particle; rendering the selected particle system; comparing the rendered particle system to the identified fuzzy object in the 2D image; and storing the selected particle system if the comparison result is within an acceptable threshold, wherein the stored particle system represents the recovered geometry of the fuzzy object.

Abstract translation: 提供了一种用于从二维（2D）图像中恢复三维（3D）粒子系统的系统和方法。 本发明的系统和方法提供用于识别二维（2D）图像中的模糊对象; 从多个预定粒子系统中选择粒子系统，所选粒子系统与预定义的模糊对象相关; 产生所选择的粒子系统的至少一个粒子; 模拟所述至少一个粒子以更新所述至少一个粒子的状态; 渲染选定的粒子系统; 将渲染的粒子系统与2D图像中识别的模糊对象进行比较; 以及如果所述比较结果在可接受的阈值内，则存储所选择的粒子系统，其中所述存储的粒子系统表示所述模糊对象的恢复的几何形状。

公开(公告)号：US08483540B2

公开(公告)日：2013-07-09

申请号：US12312362

申请日：2006-12-12

Applicant: Ingo Doser ,  Ana Belen Benitez ,  Dong-Qing Zhang

Inventor： Ingo Doser ,  Ana Belen Benitez ,  Dong-Qing Zhang

IPC: H04N5/932 ,  H04N5/935

CPC classification number: G11B27/28 ,  G11B27/10 ,  H04N5/76 ,  H04N9/802 ,  H04N21/2368 ,  H04N21/4307 ,  H04N21/4334 ,  H04N21/4341

Abstract: A method, apparatus and system for synchronizing between two recording modes includes identifying a common event in the two recording modes. The event in time is recognized for a higher accuracy mode of the two modes. The event is predicted in a lower accuracy mode of the two modes by determining a time when the event occurred between frames in the lower accuracy mode. The event in the higher accuracy mode is synchronized to the lower accuracy mode to provide sub-frame accuracy alignment between the two modes. In one embodiment of the invention, the common event includes the closing of a clap slate, and the two modes include audio and video recording modes.

Abstract translation: 用于在两种记录模式之间同步的方法，装置和系统包括识别两种记录模式中的公共事件。 对于两种模式的更高精度模式，识别出时间上的事件。 通过确定在较低精度模式中的帧之间发生事件的时间，在两种模式的较低精度模式中预测该事件。 在较高精度模式下的事件与较低精度模式同步，以提供两种模式之间的子帧精度对准。 在本发明的一个实施例中，公共事件包括拍子拍板的关闭，并且两种模式包括音频和视频记录模式。

公开(公告)号：US20130170746A1

公开(公告)日：2013-07-04

申请号：US13821424

申请日：2011-09-09

Applicant: Dong-Qing Zhang ,  Sitaram Bhagavathy ,  Shan He

Inventor： Dong-Qing Zhang ,  Sitaram Bhagavathy ,  Shan He

IPC: G06T5/00

CPC classification number: H04N19/85 ,  G06T5/001 ,  H04N19/132 ,  H04N19/14 ,  H04N19/176 ,  H04N19/196 ,  H04N19/44 ,  H04N19/46 ,  H04N19/463 ,  H04N19/587 ,  H04N19/59 ,  H04N19/593 ,  H04N19/61 ,  H04N19/97

Abstract: Method and apparatus for recovering a pruned version of a picture in a video sequence are disclosed. The apparatus includes a divider for dividing the pruned version of the picture into a plurality of non-overlapping blocks. The apparatus also includes a metadata decoder for decoding metadata for use in recovering the pruned version of the picture. The apparatus further includes a patch library creator for creating a patch library from a reconstructed version of the picture. The patch library includes a plurality of high resolution replacement patches for replacing the one or more pruned blocks during a recovery of the pruned version of the picture. The apparatus additionally includes a search and replacement device for performing a searching process using the metadata to find a corresponding patch for a respective one of the one or more pruned blocks from among the plurality of non-overlapping blocks and replace the respective one of the one or more pruned blocks with the corresponding patch. The signature is respectively created for each of the one or more pruned blocks, and the pruned version of the picture is recovered by comparing respective distance metrics from signatures for each of the plurality of high resolution patches to signatures for each of the one or more pruned blocks, sorting the respective distance metrics to obtain a rank list for each of the one or more pruned blocks, wherein a rank number in the rank list for a particular one of the one or more pruned blocks is used to retrieve a corresponding one of the plurality of high resolution patches in the patch library to be used to replace the particular one of the one or more pruned blocks. A patch dependency graph having a plurality of nodes and a plurality of edges is used to recover the pruned version of the picture. Each of the plurality of nodes represents a respective one of the plurality of overlapping blocks, and each of the plurality of edges represents a respective dependency of at least the respective one of the plurality of overlapping blocks.

公开(公告)号：US20110085739A1

公开(公告)日：2011-04-14

申请号：US12996424

申请日：2008-06-06

Applicant: Dong-Qing Zhang ,  Rajan Joshi ,  Ju Guo ,  Ana B. Benitez ,  Ying Luo

Inventor： Dong-Qing Zhang ,  Rajan Joshi ,  Ju Guo ,  Ana B. Benitez ,  Ying Luo

IPC: G06K9/68 ,  G06K9/62 ,  G06K9/46

CPC classification number: G06F16/58 ,  G06F16/583

Abstract: A system and method for an efficient semantic similarity search of images with a classification structure are provided. The system and method provide for building a semantic classification-search tree for the plurality of images, the classification tree including at least two categories of images, each category of images representing a subset of the plurality of images, receiving a query image, classifying the query image to select one of the at least two categories of images, and restricting the search for the image of interest using the query image to the selected one of the at least two categories of images.

Abstract translation: 提供了一种用于具有分类结构的图像的有效语义相似性搜索的系统和方法。 该系统和方法提供用于构建多个图像的语义分类搜索树，分类树包括至少两个图像类别，每个类别的图像表示多个图像的子集，接收查询图像，分类 查询图像以选择所述至少两个类别的图像中的一个，并且使用查询图像将所搜索的图像搜索到所选择的至少两个图像类别中。