公开(公告)号：US08687697B2

公开(公告)日：2014-04-01

申请号：US13455094

申请日：2012-04-24

申请人： Sridhar Srinivasan ,  Pohsiang Hsu ,  Thomas W. Holcomb ,  Kunal Mukerjee ,  Bruce Chih-Lung Lin

发明人： Sridhar Srinivasan ,  Pohsiang Hsu ,  Thomas W. Holcomb ,  Kunal Mukerjee ,  Bruce Chih-Lung Lin

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  G06K9/36 ,  G06K9/46

CPC分类号： H04N19/137 ,  G06K9/36 ,  G06K9/46 ,  H04N7/52 ,  H04N19/132 ,  H04N19/139 ,  H04N19/176 ,  H04N19/51 ,  H04N19/513 ,  H04N19/61 ,  H04N19/63 ,  H04N19/91

摘要： Techniques and tools for encoding and decoding motion vector information for video images are described. For example, a video encoder yields an extended motion vector code by jointly coding, for a set of pixels, a switch code, motion vector information, and a terminal symbol indicating whether subsequent data is encoded for the set of pixels. In another aspect, an encoder/decoder selects motion vector predictors for macroblocks. In another aspect, a video encoder/decoder uses hybrid motion vector prediction. In another aspect, a video encoder/decoder signals a motion vector mode for a predicted image. In another aspect, a video decoder decodes a set of pixels by receiving an extended motion vector code, which reflects joint encoding of motion information together with intra/inter-coding information and a terminal symbol. The decoder determines whether subsequent data exists for the set of pixels based on e.g., the terminal symbol.

公开(公告)号：US08625669B2

公开(公告)日：2014-01-07

申请号：US12401831

申请日：2009-03-11

申请人： Thomas W. Holcomb

发明人： Thomas W. Holcomb

IPC分类号： H04N7/12

CPC分类号： H04N19/16 ,  H04N19/102 ,  H04N19/109 ,  H04N19/11 ,  H04N19/112 ,  H04N19/117 ,  H04N19/129 ,  H04N19/13 ,  H04N19/137 ,  H04N19/146 ,  H04N19/147 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/18 ,  H04N19/184 ,  H04N19/186 ,  H04N19/196 ,  H04N19/46 ,  H04N19/463 ,  H04N19/51 ,  H04N19/52 ,  H04N19/523 ,  H04N19/593 ,  H04N19/61 ,  H04N19/63 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86 ,  H04N19/93

摘要： Techniques and tools for encoding and decoding predicted images in interlaced video are described. For example, a video encoder or decoder computes a motion vector predictor for a motion vector for a portion (e.g., a block or macroblock) of an interlaced P-field, including selecting between using a same polarity or opposite polarity motion vector predictor for the portion. The encoder/decoder processes the motion vector based at least in part on the motion vector predictor computed for the motion vector. The processing can comprise computing a motion vector differential between the motion vector and the motion vector predictor during encoding and reconstructing the motion vector from a motion vector differential and the motion vector predictor during decoding. The selecting can be based at least in part on a count of opposite polarity motion vectors for a neighborhood around the portion and/or a count of same polarity motion vectors.

摘要翻译： 描述了用于对隔行视频中的预测图像进行编码和解码的技术和工具。 例如，视频编码器或解码器计算用于隔行P场的一部分（例如，块或宏块）的运动矢量的运动矢量预测器，包括在使用相同极性或相反极性的运动矢量预测器之间进行选择 一部分。 编码器/解码器至少部分地基于为运动矢量计算的运动矢量预测器来处理运动矢量。 处理可以包括在编码期间计算运动矢量和运动矢量预测器之间的运动矢量差分，并且在解码期间重建来自运动矢量差分的运动矢量和运动矢量预测器。 该选择可以至少部分地基于对于该部分周围的邻域的相反极性运动矢量的计数和/或相同极性运动矢量的计数。

公开(公告)号：US08379851B2

公开(公告)日：2013-02-19

申请号：US12119364

申请日：2008-05-12

申请人： Sanjeev Mehrotra ,  Kishore Kotteri ,  Bharath Siravara ,  Thomas W. Holcomb ,  Hui Gao ,  Serge Smirnov

发明人： Sanjeev Mehrotra ,  Kishore Kotteri ,  Bharath Siravara ,  Thomas W. Holcomb ,  Hui Gao ,  Serge Smirnov

IPC分类号： H04N7/167 ,  G06F15/16

CPC分类号： H04L65/607 ,  H04L65/608 ,  H04N21/00

摘要： An indexed file layout, comprising index information, is defined for segmented streaming of multimedia content. The index information can comprise program description information and streaming segment index information. In addition, the layout can comprise files containing streaming segments of the program, where the streaming segments are each encoded at one or more bitrates independently of other streaming segments of the program. The layout supports client switching between different bitrates at segment boundaries. Optimized client-side rate control of streaming content can be provided by defining a plurality of states, selecting available paths based on constraint conditions, and selecting a best path through the states (e.g., based on a distortion measure). In one client-side rate control solution states correspond to a specific bitrate of a specific streaming segment, and in another client-side rate control solution states correspond to a measure of client buffer fullness.

摘要翻译： 包括索引信息的索引文件布局被定义用于多媒体内容的分段流。 索引信息可以包括节目描述信息和流分片索引信息。 此外，布局可以包括包含程序的流片段的文件，其中流片段每个以独立于节目的其他流片段的一个或多个比特率进行编码。 该布局支持在段边界处的不同比特率之间的客户端切换。 可以通过定义多个状态，基于约束条件选择可用路径以及选择通过状态的最佳路径（例如，基于失真度量）来提供流内容的优化客户端速率控制。 在一个客户端速率控制解决方案中，状态对应于特定流分段的特定比特率，并且在另一客户端速率控制解决方案状态对应于客户端缓冲区充满度的度量。

公开(公告)号：US20120294355A1

公开(公告)日：2012-11-22

申请号：US13109554

申请日：2011-05-17

申请人： Thomas W. Holcomb ,  Chih-Lung B. Lin

发明人： Thomas W. Holcomb ,  Chih-Lung B. Lin

IPC分类号： H04N7/26

CPC分类号： H04N19/40 ,  H04N19/132 ,  H04N19/14 ,  H04N19/15 ,  H04N19/157 ,  H04N19/172

摘要： An apparatus and method are disclosed for transcoding a compressed video stream. In one embodiment, a compressed video stream is decoded. A spatial resolution of the decoded video stream can then be dynamically modified. The video stream with the modified spatial resolution can be re-encoded and transmitted over a network for display on a client device. The spatial resolution can be dynamically modified based on a variety of techniques. For example, a current bitrate and quantization parameters associated with the frames can be used to determine the spatial resolution. Alternatively, the spatial and/or temporal complexity can be used to modify spatial resolution.

摘要翻译： 公开了一种用于对压缩视频流进行代码转换的装置和方法。 在一个实施例中，对压缩视频流进行解码。 然后可以动态地修改解码的视频流的空间分辨率。 具有修改的空间分辨率的视频流可以被重新编码并通过网络发送以在客户端设备上显示。 可以基于各种技术来动态修改空间分辨率。 例如，可以使用与帧相关联的当前比特率和量化参数来确定空间分辨率。 或者，可以使用空间和/或时间复杂度来修改空间分辨率。

公开(公告)号：US20120269266A1

公开(公告)日：2012-10-25

申请号：US13539730

申请日：2012-07-02

申请人： Chih-Lung Lin ,  Ming-Chieh Lee ,  Stacey Spears ,  Philip Lawrence Garrett ,  Anil Madhav Murching ,  Amy Jennifer Beauford ,  Thomas W. Holcomb ,  Xiping Zuo

发明人： Chih-Lung Lin ,  Ming-Chieh Lee ,  Stacey Spears ,  Philip Lawrence Garrett ,  Anil Madhav Murching ,  Amy Jennifer Beauford ,  Thomas W. Holcomb ,  Xiping Zuo

IPC分类号： H04N7/26

CPC分类号： H04N19/17 ,  H04N19/124 ,  H04N19/147 ,  H04N19/162 ,  H04N19/61

摘要： Quality settings established by an encoder are adjusted based on information associated with regions of interest (“ROIs”). For example, quantization step sizes can be reduced (to improve quality) or increased (to reduce bit rate). ROIs can be identified and quality settings can be adjusted based on input received from a user interface. An overlap setting can be determined for a portion of a picture that corresponds to an ROI overlap area. For example, an overlap setting is chosen from step sizes corresponding to a first overlapping ROI and a second overlapping ROI, or from relative reductions in step size corresponding to the first ROI and the second ROI. ROIs can be parameterized by information (e.g., using data structures) that indicates spatial dimensions of the ROIs and quality adjustment information (e.g., dead zone information, step size information, and quantization mode information).

摘要翻译： 基于与兴趣区域（ROI）相关联的信息来调整由编码器建立的质量设置。 例如，可以减小量化步长（提高质量）或增加（以减少比特率）。 可以识别ROI，并且可以基于从用户界面接收的输入来调整质量设置。 可以针对对应于ROI重叠区域的图像的一部分来确定重叠设置。 例如，从与第一重叠ROI和第二重叠ROI相对应的步长尺寸或从与第一ROI和第二ROI对应的步长的相对减小中选择重叠设置。 可以通过指示ROI的空间维度和质量调整信息（例如，死区信息，步长信息和量化模式信息）的信息（例如，使用数据结构）对ROI进行参数化。

公开(公告)号：US20120213280A1

公开(公告)日：2012-08-23

申请号：US13455094

申请日：2012-04-24

申请人： Sridhar Srinivasan ,  Pohsiang Hsu ,  Thomas W. Holcomb ,  Kunal Mukerjee ,  Bruce Chih-Lung Lin

发明人： Sridhar Srinivasan ,  Pohsiang Hsu ,  Thomas W. Holcomb ,  Kunal Mukerjee ,  Bruce Chih-Lung Lin

IPC分类号： H04N7/32

CPC分类号： H04N19/137 ,  G06K9/36 ,  G06K9/46 ,  H04N7/52 ,  H04N19/132 ,  H04N19/139 ,  H04N19/176 ,  H04N19/51 ,  H04N19/513 ,  H04N19/61 ,  H04N19/63 ,  H04N19/91

摘要： Techniques and tools for encoding and decoding motion vector information for video images are described. For example, a video encoder yields an extended motion vector code by jointly coding, for a set of pixels, a switch code, motion vector information, and a terminal symbol indicating whether subsequent data is encoded for the set of pixels. In another aspect, an encoder/decoder selects motion vector predictors for macroblocks. In another aspect, a video encoder/decoder uses hybrid motion vector prediction. In another aspect, a video encoder/decoder signals a motion vector mode for a predicted image. In another aspect, a video decoder decodes a set of pixels by receiving an extended motion vector code, which reflects joint encoding of motion information together with intra/inter-coding information and a terminal symbol. The decoder determines whether subsequent data exists for the set of pixels based on e.g., the terminal symbol.

摘要翻译： 描述用于编码和解码用于视频图像的运动矢量信息的技术和工具。 例如，视频编码器通过针对一组像素共同编码一个开关码，运动矢量信息和指示后续数据是否被编码用于像素集合的终端符号来产生扩展运动矢量码。 在另一方面，编码器/解码器为宏块选择运动矢量预测器。 在另一方面，视频编码器/解码器使用混合运动矢量预测。 在另一方面，视频编码器/解码器针对预测图像发送运动矢量模式。 在另一方面，视频解码器通过接收扩展运动矢量码来解码一组像素，该扩展运动矢量码反映运动信息的联合编码以及帧内/帧间编码信息和终端符号。 解码器基于例如终端符号确定对于像素集合是否存在后续数据。

公开(公告)号：US08243820B2

公开(公告)日：2012-08-14

申请号：US11118686

申请日：2005-04-29

申请人： Thomas W. Holcomb ,  Chih-Lung Lin ,  Pohsiang Hsu ,  Sridhar Srinivasan

发明人： Thomas W. Holcomb ,  Chih-Lung Lin ,  Pohsiang Hsu ,  Sridhar Srinivasan

IPC分类号： H04N7/12

CPC分类号： H04N19/59 ,  H04N19/107 ,  H04N19/136 ,  H04N19/152 ,  H04N19/156 ,  H04N19/164 ,  H04N19/174 ,  H04N19/176 ,  H04N19/177 ,  H04N19/179 ,  H04N19/46 ,  H04N19/70 ,  H04N19/80

摘要： A video codec provides for encoding and decoding pictures of a video sequence at various coded resolutions, such that pictures can be encoded at lower coded resolutions based on bit rate or other constraints while maintaining a consistent display resolution. The video codec further provide for encoding and decoding pictures of the video sequence at ranges lower than that used for display, and then expanding the range after decoding for display. The video codec applies post-processing operations, such as de-blocking, de-ringing, and color conversion, at the native resolution and range of the decoded video, prior to range expansion and upsampling for display.

摘要翻译： 视频编解码器提供以各种编码分辨率编码和解码视频序列的图像，使得可以在保持一致的显示分辨率的情况下，以比特率或其他约束为基础，以较低的编码分辨率编码图像。 视频编解码器进一步提供对视频序列的图像进行编码和解码，范围低于用于显示的视频序列，然后扩展解码后的范围进行显示。 视频编解码器在范围扩展和上采样显示之前，以解码视频的原始分辨率和范围应用后处理操作，如解块，去声和颜色转换。

公开(公告)号：US08160132B2

公开(公告)日：2012-04-17

申请号：US12070181

申请日：2008-02-15

申请人： Thomas W. Holcomb

发明人： Thomas W. Holcomb

IPC分类号： H04N7/12

CPC分类号： H04N19/86 ,  H04N19/117 ,  H04N19/159 ,  H04N19/172 ,  H04N19/61 ,  H04N19/80

摘要： Techniques and tools are described for reducing key picture popping effects. In some embodiments, an encoding system filters a video picture that is to be encoded as a key picture using intra-picture compression. The filtering reduces detail in the picture relative to other video pictures that are to be encoded using inter-picture compression. In many cases, the filtering reduces key picture popping effects by selectively attenuating detail in the picture that is to be encoded as a key picture. The encoding tool can use a key picture filter strength parameter to control strength of the filtering. The tool encodes the filtered video picture using intra-picture compression and encodes the other video pictures using inter-picture compression.

摘要翻译： 描述了技术和工具来减少关键图像弹出效果。 在一些实施例中，编码系统使用图像内压缩对要编码为关键图像的视频图像进行滤波。 该滤波可以减少图像中相对于使用图像间压缩进行编码的其他视频图像的细节。 在许多情况下，滤波通过选择性地衰减要编码为关键图像的图像中的细节来减少关键图像弹出效果。 编码工具可以使用关键图像滤波强度参数来控制滤波的强度。 该工具使用图像内压缩对经滤波的视频图像进行编码，并使用图像间压缩对其他视频图像进行编码。

公开(公告)号：US20100189183A1

公开(公告)日：2010-07-29

申请号：US12362420

申请日：2009-01-29

申请人： Chuang Gu ,  Chun-Wei Chan ,  William Chen ,  Stacey Spears ,  Thomas W. Holcomb ,  Chih-Lung Lin ,  Sanjeev Mehrotra

发明人： Chuang Gu ,  Chun-Wei Chan ,  William Chen ,  Stacey Spears ,  Thomas W. Holcomb ,  Chih-Lung Lin ,  Sanjeev Mehrotra

IPC分类号： H04N7/26

CPC分类号： H04N21/4621 ,  H04N19/124 ,  H04N19/14 ,  H04N19/149 ,  H04N19/177 ,  H04N19/61 ,  H04N19/85 ,  H04N21/23439 ,  H04N21/6373 ,  H04N21/8456

摘要： A video encoding system encodes video streams for multiple bit rate video streaming using an approach that permits the encoded bit rate to vary subject to a peak bit rate and average bit rate constraints for higher quality streams, while a bottom bit rate stream is encoded to achieve a constant chunk rate. The video encoding system also dynamically decides an encoding resolution for segments of the multiple bit rate video streams that varies with video complexity so as to achieve a better visual experience for multiple bit rate streaming.

摘要翻译： 视频编码系统使用允许编码比特率根据高质量流的峰比特率和平均比特率约束而变化的方法对多个比特率视频流的视频流进行编码，而底部比特率流被编码以实现 恒定的块率。 视频编码系统还动态地决定了随着视频复杂度而变化的多个比特率视频流的段的编码分辨率，从而为多个比特率流实现更好的视觉体验。

公开(公告)号：US20100135383A1

公开(公告)日：2010-06-03

申请号：US12324987

申请日：2008-11-28

申请人： Weidong Zhao ,  Thomas W. Holcomb ,  Chih-Lung B. Lin ,  William R. Sanders ,  Shijun Sun

发明人： Weidong Zhao ,  Thomas W. Holcomb ,  Chih-Lung B. Lin ,  William R. Sanders ,  Shijun Sun

IPC分类号： H04N7/24

CPC分类号： G06F9/50 ,  H04N19/42 ,  H04N19/439

摘要： An encoder is disclosed that is partitioned into discrete hardware modules. The discrete modules include multiple re-entry and exit points that allow enhanced control by software. The software can control the discrete modules during the encoding process and make adjustments according to CPU bandwidth and/or user requirements allowing for enhanced quality control and seamless hardware/software operations. In one embodiment, a media stream is received into an encoder that includes a pipeline of multiple hardware stages for encoding. An intermediate result is provided from at least one of the hardware stages to an encoding control module that processes the intermediate result to determine configuration instructions for a next hardware stage in the pipeline. Thus, the encoding process can be modified dynamically through hardware and software interactions as the media stream progresses through the pipeline of the encoder.

摘要翻译： 公开了一种被分割成离散硬件模块的编码器。 离散模块包括多个重入点和出口点，可以通过软件进行增强的控制。 该软件可以在编码过程中控制分立模块，并根据CPU带宽和/或用户要求进行调整，从而实现增强的质量控制和无缝的硬件/软件操作。 在一个实施例中，将媒体流接收到包括用于编码的多个硬件级的流水线的编码器中。 将中间结果从至少一个硬件级提供给编码控制模块，该编码控制模块处理中间结果以确定流水线中下一个硬件级的配置指令。 因此，当媒体流通过编码器的流水线进行时，可以通过硬件和软件交互来动态地修改编码过程。