公开(公告)号：US08254455B2

公开(公告)日：2012-08-28

申请号：US11824550

申请日：2007-06-30

申请人： Yongjun Wu ,  William Chen ,  Weidong Zhao

发明人： Yongjun Wu ,  William Chen ,  Weidong Zhao

IPC分类号： H04N7/12

CPC分类号： H04N19/86 ,  H04N19/117 ,  H04N19/132 ,  H04N19/154 ,  H04N19/172 ,  H04N19/176 ,  H04N19/436 ,  H04N19/44 ,  H04N19/587 ,  H04N19/61 ,  H04N19/89 ,  H04N19/91

摘要： Video decoding innovations for multithreading implementations and graphics processor unit (“GPU”) implementations are described. For example, for multithreaded decoding, a decoder uses innovations in the areas of layered data structures, picture extent discovery, a picture command queue, and/or task scheduling for multithreading. Or, for a GPU implementation, a decoder uses innovations in the areas of inverse transforms, inverse quantization, fractional interpolation, intra prediction using waves, loop filtering using waves, memory usage and/or performance-adaptive loop filtering. Innovations are also described in the areas of error handling and recovery, determination of neighbor availability for operations such as context modeling and intra prediction, CABAC decoding, computation of collocated information for direct mode macroblocks in B slices, reduction of memory consumption, implementation of trick play modes, and picture dropping for quality adjustment.

摘要翻译： 描述了用于多线程实现和图形处理器单元（“GPU”）实现的视频解码创新。 例如，对于多线程解码，解码器在分层数据结构，图像范围发现，图像命令队列和/或多线程的任务调度的领域中使用创新。 或者，对于GPU实现，解码器在逆变换，逆量化，分数插值，使用波的帧内预测，​​使用波的循环滤波，存储器使用和/或性能自适应环路滤波的领域中使用创新。 创新还在错误处理和恢复领域进行了描述，确定了上下文建模和帧内预测等操作的邻居可用性，CABAC解码，B片中直接模式宏块的并置信息的计算，内存消耗的减少，技巧的实现 播放模式和图​​片下降以进行质量调整。

公开(公告)号：US20120147973A1

公开(公告)日：2012-06-14

申请号：US12966914

申请日：2010-12-13

申请人： Yongjun Wu ,  Gang Ji ,  Shyam Sadhwani

发明人： Yongjun Wu ,  Gang Ji ,  Shyam Sadhwani

IPC分类号： H04N7/26

CPC分类号： H04N19/188 ,  H04N19/103 ,  H04N19/156 ,  H04N19/1883 ,  H04N19/42 ,  H04N19/44 ,  H04N19/70

摘要： Techniques and tools for reducing latency in video decoding for real-time communication applications that emphasize low delay. For example, a tool such as a video decoder selects a low-latency decoding mode. Based on the selected decoding mode, the tool adjusts output timing determination, picture boundary detection, number of pictures in flight and/or jitter buffer utilization. For low-latency decoding, the tool can use a frame count syntax element to set initial output delay for a decoded picture buffer, and the tool can use auxiliary delimiter syntax elements to detect picture boundaries. To further reduce delay in low-latency decoding, the tool can reduce number of pictures in flight for multi-threaded decoding and reduce or remove jitter buffers. The tool receives encoded data, performs decoding according to the selected decoding mode to reconstruct pictures, and outputs the pictures for display.

摘要翻译： 用于减少视频解码中延迟延迟的技术和工具，用于强调低延迟的实时通信应用。 例如，诸如视频解码器的工具选择低延迟解码模式。 基于选择的解码模式，该工具调整输出定时确定，图像边界检测，飞行中的图像数和/或抖动缓冲器利用率。 对于低延迟解码，该工具可以使用帧计数语法元素为解码图像缓冲区设置初始输出延迟，并且该工具可以使用辅助分隔符语法元素来检测图像边界。 为了进一步减少低延迟解码的延迟，该工具可以减少飞行中用于多线程解码的图片数量，并减少或删除抖动缓冲区。 该工具接收编码数据，根据选择的解码模式执行解码以重构图像，并输出用于显示的图像。

公开(公告)号：US08189666B2

公开(公告)日：2012-05-29

申请号：US12364325

申请日：2009-02-02

申请人： Yongjun Wu ,  Naveen Thumpudi ,  Kim-chyan Gan

发明人： Yongjun Wu ,  Naveen Thumpudi ,  Kim-chyan Gan

IPC分类号： H04N7/36 ,  H04N11/02

CPC分类号： H04N19/44 ,  H04N19/102 ,  H04N19/159 ,  H04N19/176 ,  H04N19/46 ,  H04N19/513 ,  H04N19/61 ,  H04N19/70

摘要： Video decoding innovations for using local picture identifiers and computing co-located information are described. In one aspect, a decoder identifies reference pictures in a reference picture list of a temporal direct prediction mode macroblock that match reference pictures used by a co-located macroblock using local picture identifiers. In another aspect, a decoder determines whether reference pictures used by blocks are the same by comparing local picture identifiers during calculation of boundary strength. In yet another aspect, a decoder determines a picture type of a picture and based on the picture type selectively skips or simplifies computation of co-located information for use in reconstructing direct prediction mode macroblocks outside the picture.

摘要翻译： 描述了使用本地图片标识符和计算共址信息的视频解码创新。 在一个方面，解码器识别与使用本地图像标识符的同位置宏块使用的参考图片相匹配的时间直接预测模式宏块的参考图片列表中的参考图片。 在另一方面，解码器通过在计算边界强度期间比较局部图像标识符来确定块使用的参考图片是否相同。 在另一方面，解码器确定图像的图像类型并且基于图像类型有选择地跳过或简化用于重建图像外部的直接预测模式宏块的共位信息的计算。

公开(公告)号：US20120099652A1

公开(公告)日：2012-04-26

申请号：US13338795

申请日：2011-12-28

申请人： John W. WOODS ,  Yongjun Wu

发明人： John W. WOODS ,  Yongjun Wu

IPC分类号： H04N7/32 ,  H04N7/26

CPC分类号： H04N19/615 ,  H04N19/13 ,  H04N19/31 ,  H04N19/36 ,  H04N19/517 ,  H04N19/61 ,  H04N19/63 ,  H04N19/647

摘要： A method and apparatus for scalable coding of a motion vector generated during motion estimation, in which a generated motion vector field is separated into a base layer and an enhancement layer according to pixel accuracies to obtain a layered structure for a motion vector. In addition, the motion vector field has a layered structure including a base layer composed of motion vectors of blocks larger than or equal to a predetermined size and at least one enhancement layer composed of motion vectors of blocks smaller than a predetermined size.

摘要翻译： 一种用于在运动估计期间生成的运动矢量的可缩放编码的方法和装置，其中根据像素精度将生成的运动矢量场分成基本层和增强层，以获得用于运动矢量的分层结构。 此外，运动矢量场具有分层结构，其包括由大于或等于预定大小的块的运动矢量构成的基本层和由小于预定大小的块的运动矢量组成的至少一个增强层。

公开(公告)号：US20100032943A1

公开(公告)日：2010-02-11

申请号：US12188589

申请日：2008-08-08

申请人： Chun-Hung LI ,  Wei-Mien Hsu ,  Yongjun Wu

发明人： Chun-Hung LI ,  Wei-Mien Hsu ,  Yongjun Wu

IPC分类号： F16L41/00

CPC分类号： F16L41/023 ,  E03C1/0403 ,  F16L37/0985

摘要： A quick installed joint assembly includes a fitting body, a sleeve, and an inlet pipe. One end of the chamber of the body communicates with a water supply pipeline, and the other end communicates with an accommodation part and passing through the fitting body. The sleeve is disposed within the accommodation part and has stopper portions. Each stopper portion has a wedge-like portion and a hook portion is extending outwardly from the wedge-like portion. The body has plural openings corresponding to each stopper portion, so that one end of the inlet pipe can pass through the sleeve and be inserted within the chamber. The inlet pipe corresponding to the bottom edge of the stopper portion has a large diameter portion for leaning against on the stopper portion, so the hook portion can be hooked on the openings and the inside wall of the accommodation part can support the wedge-like portion.

摘要翻译： 快速安装的接头组件包括配件主体，套筒和入口管。 本体室的一端与供水管道连通，另一端与容纳部分连通并穿过配件体。 套筒设置在容纳部分内并具有止动部分。 每个止动部分具有楔形部分，并且钩部分从楔形部分向外延伸。 主体具有对应于每个止挡部分的多个开口，使得入口管的一端可以穿过套筒并插入腔室内。 对应于止动部分的底部边缘的入口管具有用于靠在止动部分上的大直径部分，因此钩部分可以钩在开口上，并且容纳部分的内壁可以支撑楔形部分 。

公开(公告)号：US09924184B2

公开(公告)日：2018-03-20

申请号：US12217037

申请日：2008-06-30

申请人： Yongjun Wu ,  Eric S. Christoffersen ,  Naveen Thumpudi

发明人： Yongjun Wu ,  Eric S. Christoffersen ,  Naveen Thumpudi

IPC分类号： H04N7/12 ,  H04N19/44 ,  H04N19/61 ,  H04N19/89

CPC分类号： H04N19/44 ,  H04N19/61 ,  H04N19/89

摘要： Error detecting and protection innovations for video decoders are described. For example, in a multithreaded video decoder, a picture extent discovery (PED) task detects an error in a video bitstream which corrupts a picture. The PED task then determines any PED sub-stage which have been completed for the picture, and based on this determination, performs error-handing PED operations. In another example, an entropy decoding (ED) task checks validity on a macroblock-by-macroblock basis using a redundant buffer to avoid overflows. Additionally, error recovery innovations are described which facilitate playback of a video bit stream at an arbitrary position. For example, a video decoder chooses a picture in the bit stream after the arbitrary position at which to begin decoding based on a determination of acceptable recovery time and/or acceptable picture quality.

公开(公告)号：US09819949B2

公开(公告)日：2017-11-14

申请号：US13329093

申请日：2011-12-16

申请人： Mei-Hsuan Lu ,  Yongjun Wu ,  Ming-Chieh Lee ,  Gary J. Sullivan

发明人： Mei-Hsuan Lu ,  Yongjun Wu ,  Ming-Chieh Lee ,  Gary J. Sullivan

IPC分类号： H04N7/50 ,  H04N7/26 ,  H04N7/12 ,  H04N19/42 ,  H04N19/30 ,  H04N19/44 ,  H04N19/423 ,  H04N19/436

CPC分类号： H04N19/42 ,  H04N19/30 ,  H04N19/423 ,  H04N19/436 ,  H04N19/44

摘要： In various respects, hardware-accelerated decoding is adapted for decoding of video that has been encoded using scalable video coding. For example, for a given picture to be decoded, a host decoder determines whether a corresponding base picture will be stored for use as a reference picture. If so, the host decoder directs decoding with an accelerator such that the some of the same decoding operations can be used for the given picture and the reference base picture. Or, as another example, the host decoder groups encoded data associated with a given layer representation in buffers. The host decoder provides the encoded data for the layer to the accelerator. The host decoder repeats the process layer-after-layer in the order that layers appear in the bitstream, according to a defined call pattern for an acceleration interface, which helps the accelerator determine the layers with which buffers are associated.

公开(公告)号：US09589540B2

公开(公告)日：2017-03-07

申请号：US13310812

申请日：2011-12-05

申请人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi ,  Stephen Estrop ,  Glenn Evans

发明人： Yongjun Wu ,  Shyam Sadhwani ,  Naveen Thumpudi ,  Stephen Estrop ,  Glenn Evans

IPC分类号： G06F3/14 ,  G09G5/12 ,  G09G5/36 ,  G06F1/32 ,  G09G3/20

CPC分类号： G09G5/363 ,  G06F1/3265 ,  G06F3/1407 ,  G09G3/2092 ,  G09G5/12 ,  G09G2330/021 ,  G09G2340/0435 ,  G09G2370/04 ,  G09G2370/20 ,  Y02D10/153

摘要： A battery operated device, having a display with two or more available refresh rates, has its refresh rate selected so as to match the video frame rate of video data played back on the display. This selection is made by coordinating the resources in the device that are used to process the video from its reception through to its display.

摘要翻译： 具有具有两个或多个可用刷新率的显示器的电池供电装置具有选择其刷新率，以便与在显示器上播放的视频数据的视频帧速率相匹配。 该选择是通过协调用于处理从其接收到其显示的视频的设备中的资源来进行的。

公开(公告)号：US09460495B2

公开(公告)日：2016-10-04

申请号：US13440993

申请日：2012-04-06

申请人： Yongjun Wu ,  Matthew Wozniak ,  Simon Baker ,  Catalin Alexandru Negrila ,  Venkata S. K. Kamal Lanka ,  Kevin Chin ,  Brian Kohlwey

发明人： Yongjun Wu ,  Matthew Wozniak ,  Simon Baker ,  Catalin Alexandru Negrila ,  Venkata S. K. Kamal Lanka ,  Kevin Chin ,  Brian Kohlwey

IPC分类号： H04N7/12 ,  G06T5/00 ,  G06T5/50 ,  H04N5/232

CPC分类号： G06T5/10 ,  G06T3/0093 ,  G06T5/006 ,  G06T5/50 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/20016 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/2329

摘要： In one embodiment, a video processing system 300 may filter a video data set to correct skew and wobble using a central processing unit 220 and a graphical processing unit 230. The video processing system 300 may apply a rolling shutter effect correction filter to an initial version of a video data set. The video processing system 300 may simultaneously apply a video stabilization filter to the initial version to produce a final version video data set.

摘要翻译： 在一个实施例中，视频处理系统300可以使用中央处理单元220和图形处理单元230来过滤视频数据集以校正偏斜和摆动。视频处理系统300可以将滚动快门效应校正滤波器应用于初始版本 的视频数据集。 视频处理系统300可以同时将视频稳定滤波器应用于初始版本以产生最终版本的视频数据集。

公开(公告)号：US08391688B2

公开(公告)日：2013-03-05

申请号：US13008797

申请日：2011-01-18

申请人： Wenbo Zhang ,  Yongjun Wu ,  Kim-chyan Gan ,  Eric Christoffersen

发明人： Wenbo Zhang ,  Yongjun Wu ,  Kim-chyan Gan ,  Eric Christoffersen

IPC分类号： H04N5/92

CPC分类号： H04N5/783 ,  G11B27/005

摘要： Systems and methods for smooth rewind playback of streamed media are provided. The media includes relatively-encoded frames and independently-encoded frames. The method includes receiving a rewind request indicating a rewind speed for rewind playback of the media, selectively dropping relatively-encoded frame(s) based on a receipt constraint and a decoding constraint to form a subset of the media, and receiving frames of the subset. The method further includes selecting, in a reverse order, a selected group of pictures (GOP) included within the subset, and decoding relatively-encoded frame(s) of the GOP in a forward sequential frame order. The method further includes caching relatively-encoded frame(s) of the GOP in the forward sequential frame order, and when caching, dropping and overwriting relatively-encoded frame(s) of the GOP selectively according to a memory constraint and/or a display constraint. The method further includes displaying relatively-encoded frame(s) of the GOP in a reverse sequential frame order.

摘要翻译： 提供了流媒体平滑回放播放的系统和方法。 媒体包括相对编码的帧和独立编码的帧。 该方法包括：接收指示用于回放媒体的回绕速度的倒带请求，基于接收约束和解码约束选择性地丢弃相对编码的帧以形成媒体的子集，以及接收该子集的帧 。 该方法还包括以相反的顺序选择包括在该子集内的所选择的图像组（GOP），并按照前向顺序帧顺序解码GOP的相对编码的帧。 该方法还包括以前向顺序帧顺序缓存GOP的相对编码的帧，并且当根据存储器约束和/或显示器缓存，丢弃和重写相对编码的GOP的一个或多个GOP时， 约束。 该方法还包括以反向顺序帧顺序显示GOP的相对编码的帧。