公开(公告)号：US08896715B2

公开(公告)日：2014-11-25

申请号：US12704047

申请日：2010-02-11

申请人： Yongjun Wu ,  Nikola Borisov ,  Weidong Zhao ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Nikola Borisov ,  Weidong Zhao ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N5/228 ,  H04N5/232

CPC分类号： H04N5/23267 ,  G06T3/0093 ,  G06T7/207 ,  H04L67/10 ,  H04N5/145 ,  H04N5/23248 ,  H04N5/23254 ,  H04N21/4223 ,  H04N21/44

摘要： Video image stabilization provides better performance on a generic platform for computing devices by evaluating available multimedia digital signal processing components, and selecting the available components to utilize according to a hierarchy structure for video stabilization performance for processing parts of the video stabilization. The video stabilization has improved motion vector estimation that employs refinement motion vector searching according to a pyramid block structure relationship starting from a downsampled resolution version of the video frames. The video stabilization also improves global motion transform estimation by performing a random sample consensus approach for processing the local motion vectors, and selection criteria for motion vector reliability. The video stabilization achieves the removal of hand shakiness smoothly by real-time one-pass or off-line two-pass temporal smoothing with error detection and correction.

摘要翻译： 视频图像稳定通过评估可用的多媒体数字信号处理组件，以及根据用于处理视频稳定化的部分的视频稳定性能的层次结构来选择可利用的组件来在计算设备的通用平台上提供更好的性能。 视频稳定已经改进了运动矢量估计，其采用根据从视频帧的下采样分辨率版本开始的金字塔块结构关系的细化运动矢量搜索。 视频稳定还通过执行用于处理局部运动矢量的随机样本共享方法以及用于运动矢量可靠性的选择标准来改进全局运动变换估计。 视频稳定通过具有错误检测和校正的实时一次或离线两遍时间平滑实现平滑地去除手抖动。

公开(公告)号：US20130215978A1

公开(公告)日：2013-08-22

申请号：US13399769

申请日：2012-02-17

申请人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N7/26

CPC分类号： H04N19/44 ,  H04N19/103 ,  H04N19/12 ,  H04N19/129 ,  H04N19/157 ,  H04N19/174 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70

摘要： A video decoder is disclosed that uses metadata in order to make optimization decisions. In one embodiment, metadata is used to choose which of multiple available decoder engines should receive a video sequence. In another embodiment, the optimization decisions can be based on length and location metadata information associated with a video sequence. Using such metadata information, a decoder engine can skip start-code scanning to make the decoding process more efficient. Also based on the choice of decoder engine, it can decide whether emulation prevention byte removal shall happen together with start code scanning or not.

摘要翻译： 公开了使用元数据以进行优化决定的视频解码器。 在一个实施例中，使用元数据来选择多个可用解码器引擎应当接收视频序列中的哪一个。 在另一个实施例中，优化决定可以基于与视频序列相关联的长度和位置元数据信息。 使用这样的元数据信息，解码器引擎可以跳过起始码扫描，以使解码过程更有效率。 同样基于解码器引擎的选择，它可以决定是否与启动代码扫描一起发生仿真预防字节删除。

公开(公告)号：US20130033612A1

公开(公告)日：2013-02-07

申请号：US13195776

申请日：2011-08-01

申请人： Yongjun Wu ,  Matthew Wozniak ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Matthew Wozniak ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N5/228

CPC分类号： G06T5/002 ,  G06T2207/20182 ,  H04N5/23254 ,  H04N5/23267

摘要： Reduced latency video stabilization methods and tools generate truncated filters for use in the temporal smoothing of global motion transforms representing jittery motion in captured video. The truncated filters comprise future and past tap counts that can be different from each other and are typically less than those of a baseline filter providing a baseline of video stabilization quality. The truncated filter future tap count can be determined experimentally by comparing a smoothed global motion transform set generated by applying a baseline filter to a video segment to those generated by multiple test filter with varying future tap counts, then settings the truncated filter future tap count based on an inflection point on an error-future tap count curve. A similar approach can be used to determine the truncated filter past tap count.

摘要翻译： 减少延迟视频稳定方法和工具生成截断的滤波器，用于表示捕获视频中的抖动运动的全局运动变换的时间平滑。 截断的滤波器包括可以彼此不同的未来和过去的分接计数，并且通常小于提供视频稳定质量基准线的基线滤波器。 可以通过将通过将基线滤波器应用于视频段而产生的平滑的全局运动变换集合与由具有变化的未来抽头计数的多个测试滤波器生成的平滑的全局运动变换集进行比较来确定截断过滤器未来抽头计数，然后设置截断的过滤器未来抽头计数 在错误 - 未来抽头计数曲线上的拐点上。 可以使用类似的方法来确定截断过滤器通过抽头计数。

公开(公告)号：US20100128778A1

公开(公告)日：2010-05-27

申请号：US12323055

申请日：2008-11-25

申请人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

发明人： Gang Ji ,  Naveen Thumpudi ,  Shyam Sadhwani ,  Yongjun Wu

IPC分类号： H04N7/30 ,  H04N7/26

CPC分类号： H04N19/42 ,  H04N19/44 ,  H04N19/61 ,  H04N19/89 ,  H04N19/93

摘要： Adjustment of hardware acceleration level in a video decoder utilizing hardware acceleration is described. Errors are detected in a bitstream as it is decoded using different levels of error detection based on decoding characteristics. A statistical analysis is performed on the error values as they are detected. In one technique, if the bitstream is categorized as fitting a high error rate state in a bitstream model, then hardware acceleration is dropped. In another technique, error statistics based on run-lengths of good and bad bitstream units are kept, and compared to predetermined thresholds. If the thresholds are exceeded, the hardware acceleration level is dropped. The level is dropped in order to take advantage of superior error handing abilities of software-based decoding over hardware-accelerated decoding.

摘要翻译： 描述了利用硬件加速度调整视频解码器中的硬件加速度水平。 在比特流中检测到错误，因为它使用基于解码特性的不同级别的错误检测被解码。 在检测到误差值时进行统计分析。 在一种技术中，如果比特流被分类为在比特列模型中拟合高错误率状态，则硬件加速度下降。 在另一种技术中，保持基于良好和不良比特流单元的游程长度的误差统计，并与预定阈值进行比较。 如果超过阈值，则硬件加速等级会下降。 为了利用基于硬件加速解码的基于软件的解码的优异的错误处理能力，该级别被丢弃。

公开(公告)号：US09924184B2

公开(公告)日：2018-03-20

申请号：US12217037

申请日：2008-06-30

申请人： Yongjun Wu ,  Eric S. Christoffersen ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Eric S. Christoffersen ,  Naveen Thumpudi

IPC分类号： H04N7/12 ,  H04N19/44 ,  H04N19/61 ,  H04N19/89

CPC分类号： H04N19/44 ,  H04N19/61 ,  H04N19/89

摘要： Error detecting and protection innovations for video decoders are described. For example, in a multithreaded video decoder, a picture extent discovery (PED) task detects an error in a video bitstream which corrupts a picture. The PED task then determines any PED sub-stage which have been completed for the picture, and based on this determination, performs error-handing PED operations. In another example, an entropy decoding (ED) task checks validity on a macroblock-by-macroblock basis using a redundant buffer to avoid overflows. Additionally, error recovery innovations are described which facilitate playback of a video bit stream at an arbitrary position. For example, a video decoder chooses a picture in the bit stream after the arbitrary position at which to begin decoding based on a determination of acceptable recovery time and/or acceptable picture quality.

公开(公告)号：US09589540B2

公开(公告)日：2017-03-07

申请号：US13310812

申请日：2011-12-05

申请人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi ,  Stephen Estrop ,  Glenn Evans

发明人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi ,  Stephen Estrop ,  Glenn Evans

IPC分类号： G06F3/14 ,  G09G5/12 ,  G09G5/36 ,  G06F1/32 ,  G09G3/20

CPC分类号： G09G5/363 ,  G06F1/3265 ,  G06F3/1407 ,  G09G3/2092 ,  G09G5/12 ,  G09G2330/021 ,  G09G2340/0435 ,  G09G2370/04 ,  G09G2370/20 ,  Y02D10/153

摘要： A battery operated device, having a display with two or more available refresh rates, has its refresh rate selected so as to match the video frame rate of video data played back on the display. This selection is made by coordinating the resources in the device that are used to process the video from its reception through to its display.

摘要翻译： 具有具有两个或多个可用刷新率的显示器的电池供电装置具有选择其刷新率，以便与在显示器上播放的视频数据的视频帧速率相匹配。 该选择是通过协调用于处理从其接收到其显示的视频的设备中的资源来进行的。

公开(公告)号：US08121189B2

公开(公告)日：2012-02-21

申请号：US11858787

申请日：2007-09-20

申请人： Florin Folta ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Florin Folta ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N11/02

CPC分类号： H04N19/42 ,  H04N19/127 ,  H04N19/159 ,  H04N19/172 ,  H04N19/44 ,  H04N19/51 ,  H04N19/61

摘要： Reference pictures can be created to assist with video decoding. For example, a method for decoding video can comprise receiving an encoded video bit stream, determining that a reference picture is needed, and creating and inserting the reference picture into the encoded video bit stream. A method for decoding video can also comprise receiving an encoded video bit stream, performing bit stream parsing, determining that a reference picture is needed, selecting a representation level for the reference picture, and conveying data for the selected reference picture to a hardware accelerated graphics processing unit. Various video operations, such as creating reference pictures and related information, can be performed by central processing units, while other video decoding operations can be performed by graphics processing units.

摘要翻译： 可以创建参考图片以协助视频解码。 例如，用于解码视频的方法可以包括接收编码的视频比特流，确定需要参考图像，以及创建并将参考图像插入到编码视频比特流中。 用于解码视频的方法还可以包括接收编码的视频比特流，执行比特流解析，确定需要参考图像，选择参考图像的表示级别，以及将所选参考图像的数据传送到硬件加速图形 处理单元。 可以由中央处理单元执行诸如创建参考图片和相关信息的各种视频操作，而其他视频解码操作可由图形处理单元执行。

公开(公告)号：US20110013889A1

公开(公告)日：2011-01-20

申请号：US12505444

申请日：2009-07-17

申请人： Yongjun Wu ,  Gang Ji ,  Shyam Sadhwani ,  Naveen Thumpudi ,  Eric S. Christoffersen

发明人： Yongjun Wu ,  Gang Ji ,  Shyam Sadhwani ,  Naveen Thumpudi ,  Eric S. Christoffersen

IPC分类号： H04N5/91 ,  H04N11/04 ,  H04N7/26

CPC分类号： H04N5/93 ,  H04N5/783 ,  H04N19/132 ,  H04N19/159 ,  H04N19/172 ,  H04N19/44 ,  H04N19/61 ,  H04N19/70 ,  H04N19/89 ,  H04N21/23424 ,  H04N21/4384 ,  H04N21/44016 ,  H04N21/485

摘要： A video bit stream with pictures comprising inter-coded content can be decoded upon receiving a channel start or file seek instruction. Pictures for beginning decoding and display of the bit stream can be selected based at least in part on one or more tuning parameters that set a preference between a latency of beginning to display video and possible defects in the displayed video. In some embodiments, to implement decoding upon a channel start or file seek, one or more types of data are generated for one or more pictures. For example, picture order counts are generated for pictures after a channel start or file seek operation. As another example, a decoder generates a frame number value that triggers re-initialization of a reference picture buffer before decoding after a channel start or file seek operation.

摘要翻译： 可以在接收到频道开始或文件搜索指令时解码包括帧间编码内容的图像的视频比特流。 可以至少部分地基于在开始显示视频的等待时间和显示的视频中的可能缺陷之间设置偏好的一个或多个调谐参数来选择用于开始解码和显示比特流的图片。 在一些实施例中，为了在信道开始或文件寻找中实现解码，为一个或多个图像生成一个或多个类型的数据。 例如，在通道开始或文件搜索操作之后，为图像生成图像顺序计数。 作为另一示例，解码器生成在通道开始或文件搜索操作之前解码之前触发参考图像缓冲器的重新初始化的帧编号值。

公开(公告)号：US20090080533A1

公开(公告)日：2009-03-26

申请号：US11858787

申请日：2007-09-20

申请人： Florin Folta ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Florin Folta ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04B1/66

CPC分类号： H04N19/42 ,  H04N19/127 ,  H04N19/159 ,  H04N19/172 ,  H04N19/44 ,  H04N19/51 ,  H04N19/61

摘要： Reference pictures can be created to assist with video decoding. For example, a method for decoding video can comprise receiving an encoded video bit stream, determining that a reference picture is needed, and creating and inserting the reference picture into the encoded video bit stream. A method for decoding video can also comprise receiving an encoded video bit stream, performing bit stream parsing, determining that a reference picture is needed, selecting a representation level for the reference picture, and conveying data for the selected reference picture to a hardware accelerated graphics processing unit. Various video operations, such as creating reference pictures and related information, can be performed by central processing units, while other video decoding operations can be performed by graphics processing units.

摘要翻译： 可以创建参考图片以协助视频解码。 例如，用于解码视频的方法可以包括接收编码的视频比特流，确定需要参考图像，以及创建并将参考图像插入到编码视频比特流中。 用于解码视频的方法还可以包括接收编码视频比特流，执行比特流解析，确定需要参考图片，选择参考图片的表示级别，以及将所选择的参考图片的数据传送到硬件加速图形 处理单元。 可以由中央处理单元执行诸如创建参考图片和相关信息的各种视频操作，而其他视频解码操作可由图形处理单元执行。

公开(公告)号：US06693962B1

公开(公告)日：2004-02-17

申请号：US09495189

申请日：2000-02-01

申请人： Anil Murching ,  Naveen Thumpudi ,  Ali Tabatabai

发明人： Anil Murching ,  Naveen Thumpudi ,  Ali Tabatabai

IPC分类号： H04N718

CPC分类号： H04N19/23 ,  G06T7/11 ,  G06T7/155 ,  G06T7/44 ,  G06T2207/10016 ,  G06T2207/20021 ,  G06T2207/20152

摘要： A method of extracting regions of homogeneous texture in a digital picture divides the digital picture into blocks, and for each block generates a feature vector as a function of the data moments. From the feature vectors a gradient for each block is extracted in one of two ways, either using a weighted Euclidean distance between the feature vectors or a probability mass function-based distance metric. The gradients are submitted to morphological preprocessing to remove small bumps in the gradient field. A watershed algorithm is then applied to the preprocessed gradient field to segment the gradient field into a set of spatially connected regions of homogeneous texture.

摘要翻译： 一种在数字图像中提取均匀纹理区域的方法将数字图像划分为块，并且对于每个块，根据数据时刻生成特征向量。 从特征向量中，以两种方式之一提取每个块的梯度，使用特征向量之间的加权欧几里德距离或基于概率质量函数的距离度量。 梯度被提交到形态预处理以去除梯度场中的小凸起。 然后将分水岭算法应用于预处理梯度场，以将梯度场分割成一组均匀纹理的空间连接区域。