公开(公告)号：US08731067B2

公开(公告)日：2014-05-20

申请号：US13223079

申请日：2011-08-31

申请人： Yongjun Wu ,  Shyam Sadhwani

发明人： Yongjun Wu ,  Shyam Sadhwani

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04

CPC分类号： H04N19/423 ,  H04N19/0049 ,  H04N19/127 ,  H04N19/136 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/426 ,  H04N19/44

摘要： Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.

摘要翻译： 这里描述的技术和工具有助于在视频解码期间有效地管理存储器，特别是当多个视频片段被同时解码时。 例如，利用剪辑自适应存储器使用，解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间，最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加，受到第二设置中的理论限制。 利用辅助信息的适应性早期释放，解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用，并且还利用非零系数值的相对稀疏度。

公开(公告)号：US08654842B2

公开(公告)日：2014-02-18

申请号：US11673423

申请日：2007-02-09

申请人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

发明人： Anand Ganesh ,  Donald J. Munsil ,  Gary J. Sullivan ,  Glenn F. Evans ,  Shyam Sadhwani ,  Stephen J. Estrop

IPC分类号： H04N7/12

CPC分类号： G06F9/5044 ,  H04N19/12 ,  H04N19/124 ,  H04N19/127 ,  H04N19/154 ,  H04N19/156 ,  H04N19/42 ,  H04N19/61 ,  H04N21/242 ,  H04N21/4302 ,  H04N21/64784

摘要： A video encoding acceleration service to increase one or more of the speed and quality of video encoding is described. The service acts as an intermediary between an arbitrary video encoder computer program application and arbitrary video acceleration hardware. The service receives one or more queries from the video encoder to identify implementation specifics of the video acceleration hardware. The service interfaces with the video acceleration hardware to obtain the implementation specifics. The service communicates the implementation specifics to the video encoder. The implementation specifics enable the video encoder to: (a) determine whether one or more of speed and quality of software encoding operations associated with the video encoder can be increased with implementation of a pipeline of one or more supported encoding pipeline configurations and capabilities, and (b) implement the pipeline by interfacing with the service.

摘要翻译： 描述了增加视频编码的速度和质量中的一个或多个的视频编码加速服务。 该服务充当任意视频编码器计算机程序应用程序和任意视频加速硬件之间的中介。 该服务从视频编码器接收一个或多个查询以识别视频加速硬件的实现细节。 该服务与视频加速硬件接口获取实现细节。 该服务将实现细节传达给视频编码器。 实施细节使得视频编码器能够：（a）确定是否可以通过实现一个或多个支持的编码流水线配置和能力的流水线来增加与视频编码器相关联的软件编码操作的速度和质量的一个或多个，以及 （b）通过与服务接口实施管道。

公开(公告)号：US08340510B2

公开(公告)日：2012-12-25

申请号：US12505444

申请日：2009-07-17

申请人： Yongjun Wu ,  Gang Ji ,  Shyam Sadhwani ,  Naveen Thumpudi ,  Eric S. Christoffersen

发明人： Yongjun Wu ,  Gang Ji ,  Shyam Sadhwani ,  Naveen Thumpudi ,  Eric S. Christoffersen

IPC分类号： H04N5/93 ,  H04N5/783

CPC分类号： H04N5/93 ,  H04N5/783 ,  H04N19/132 ,  H04N19/159 ,  H04N19/172 ,  H04N19/44 ,  H04N19/61 ,  H04N19/70 ,  H04N19/89 ,  H04N21/23424 ,  H04N21/4384 ,  H04N21/44016 ,  H04N21/485

摘要： A video bit stream with pictures comprising inter-coded content can be decoded upon receiving a channel start or file seek instruction. Pictures for beginning decoding and display of the bit stream can be selected based at least in part on one or more tuning parameters that set a preference between a latency of beginning to display video and possible defects in the displayed video. In some embodiments, to implement decoding upon a channel start or file seek, one or more types of data are generated for one or more pictures. For example, picture order counts are generated for pictures after a channel start or file seek operation. As another example, a decoder generates a frame number value that triggers re-initialization of a reference picture buffer before decoding after a channel start or file seek operation.

摘要翻译： 可以在接收到频道开始或文件寻道指令时解码包含帧间编码内容的图像的视频比特流。 可以至少部分地基于在开始显示视频的等待时间和显示的视频中的可能缺陷之间设置偏好的一个或多个调谐参数来选择用于开始解码和显示比特流的图片。 在一些实施例中，为了在信道开始或文件寻找中实现解码，为一个或多个图像生成一个或多个类型的数据。 例如，在通道开始或文件搜索操作之后，为图像生成图像顺序计数。 作为另一示例，解码器生成在通道开始或文件搜索操作之前解码之前触发参考图像缓冲器的重新初始化的帧编号值。

公开(公告)号：US20120163470A1

公开(公告)日：2012-06-28

申请号：US12978501

申请日：2010-12-24

申请人： Yongjun Wu ,  Shyam Sadhwani ,  Daniele Terdina

发明人： Yongjun Wu ,  Shyam Sadhwani ,  Daniele Terdina

IPC分类号： H04N7/26

CPC分类号： H04N19/44 ,  H04N19/122 ,  H04N19/127 ,  H04N19/14 ,  H04N19/176 ,  H04N19/436 ,  H04N19/46

摘要： Efficient operations in image or video decoding. For example, a tool such as an image or video decoder receives and decodes encoded data for a picture in a bitstream. As part of the decoding, the tool adapts a multi-symbol lookup table to use in decoding of symbols then decodes the symbols using the multi-symbol lookup table, producing exactly correct results. The tool can also perform selectively truncated inverse frequency transforms. For a given block, the tool identifies upper horizontal and vertical frequencies among non-zero coefficients for the block and, based on the upper frequency values, selectively applies a simplified inverse frequency transform to transform coefficients for the block without hurting decoding quality. Using restart markers in the bitstream, the tool can organize multiple blocks of the picture as partitions. The tool decodes at least some of the partitions in parallel on a partition-by-partition basis using multiple processing cores.

摘要翻译： 高效的图像或视频解码操作。 例如，诸如图像或视频解码器的工具在比特流中接收并解码图像的编码数据。 作为解码的一部分，该工具适应多符号查找表以在符号解码中使用，然后使用多符号查找表对符号进行解码，产生完全正确的结果。 该工具还可以执行选择性截断的反频率变换。 对于给定的块，该工具识别块的非零系数之间的上部水平和垂直频率，并且基于较高频率值，选择性地应用简化的反频率变换来对块的系数进行变换而不损害解码质量。 在比特流中使用重新启动标记，该工具可以将图片的多个块组织为分区。 该工具使用多个处理核在逐个分区的基础上并行解码至少一些分区。

公开(公告)号：US20110193978A1

公开(公告)日：2011-08-11

申请号：US12704047

申请日：2010-02-11

申请人： Yongjun Wu ,  Nikola Borisov ,  Weidong Zhao ,  Shyam Sadhwani ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Nikola Borisov ,  Weidong Zhao ,  Shyam Sadhwani ,  Naveen Thumpudi

IPC分类号： H04N5/228

CPC分类号： H04N5/23267 ,  G06T3/0093 ,  G06T7/207 ,  H04L67/10 ,  H04N5/145 ,  H04N5/23248 ,  H04N5/23254 ,  H04N21/4223 ,  H04N21/44

摘要： Video image stabilization provides better performance on a generic platform for computing devices by evaluating available multimedia digital signal processing components, and selecting the available components to utilize according to a hierarchy structure for video stabilization performance for processing parts of the video stabilization. The video stabilization has improved motion vector estimation that employs refinement motion vector searching according to a pyramid block structure relationship starting from a downsampled resolution version of the video frames. The video stabilization also improves global motion transform estimation by performing a random sample consensus approach for processing the local motion vectors, and selection criteria for motion vector reliability. The video stabilization achieves the removal of hand shakiness smoothly by real-time one-pass or off-line two-pass temporal smoothing with error detection and correction.

摘要翻译： 视频图像稳定通过评估可用的多媒体数字信号处理组件，以及根据用于处理视频稳定化的部分的视频稳定性能的层次结构来选择可利用的组件来在计算设备的通用平台上提供更好的性能。 视频稳定已经改进了运动矢量估计，其采用根据从视频帧的下采样分辨率版本开始的金字塔块结构关系的细化运动矢量搜索。 视频稳定还通过执行用于处理局部运动矢量的随机样本共享方法以及用于运动矢量可靠性的选择标准来改进全局运动变换估计。 视频稳定通过具有错误检测和校正的实时一次或离线两遍时间平滑实现平滑地去除手抖动。