公开(公告)号：US08265148B2

公开(公告)日：2012-09-11

申请号：US11838758

申请日：2007-08-14

Applicant: Sridhar Srinivasan ,  Shankar Regunathan

Inventor： Sridhar Srinivasan ,  Shankar Regunathan

IPC: H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04B1/66

CPC classification number: H04N19/61 ,  H04N19/17 ,  H04N19/186 ,  H04N19/46 ,  H04N19/51 ,  H04N19/517 ,  H04N19/53 ,  H04N19/70 ,  H04N19/85 ,  H04N19/91 ,  H04N19/93

Abstract: Techniques and tools for performing fading compensation in video processing applications are described. For example, during encoding, a video encoder performs fading compensation using fading parameters comprising a scaling parameter and a shifting parameter on one or more reference images. During decoding, a video decoder performs corresponding fading compensation on the one or more reference images.

Abstract translation: 描述了在视频处理应用中执行衰落补偿的技术和工具。 例如，在编码期间，视频编码器使用包括缩放参数和一个或多个参考图像上的移位参数的衰落参数来执行衰落补偿。 在解码期间，视频解码器对一个或多个参考图像执行相应的衰落补偿。

公开(公告)号：US08249145B2

公开(公告)日：2012-08-21

申请号：US13248784

申请日：2011-09-29

Applicant: Cheng Chang ,  Chih-Lung B. Lin ,  Shankar Regunathan

Inventor： Cheng Chang ,  Chih-Lung B. Lin ,  Shankar Regunathan

IPC: H04N7/12

CPC classification number: H04N19/625 ,  H04N19/126 ,  H04N19/61

Abstract: Techniques and tools are described for compensating for rounding when estimating sample-domain distortion in the transform domain. For example, a video encoder estimates pixel-domain distortion in the transform domain for a block of transform coefficients after compensating for rounding in the DC coefficient of the block. In this way, the video encoder improves the accuracy of pixel-domain distortion estimation but retains the computational advantages of performing the estimation in the transform domain. Rounding compensation includes, for example, looking up an index (from a de-quantized transform coefficient) in a rounding offset table to determine a rounding offset, then adjusting the coefficient by the offset. Other techniques and tools described herein are directed to creating rounding offset tables and encoders that make encoding decisions after considering rounding effects that occur after an inverse frequency transform on de-quantized transform coefficient values.

Abstract translation: 描述了在估计变换域中的样本域失真时补偿舍入的技术和工具。 例如，视频编码器在补偿块的DC系数中的舍入后估计变换系数块的变换域中的像素域失真。 以这种方式，视频编码器提高了像素域失真估计的精度，但保留了在变换域中执行估计的计算优点。 舍入补偿包括例如在舍入偏移表中查找索引（来自去量化的变换系数）以确定舍入偏移，然后将系数调整为偏移。 本文描述的其他技术和工具旨在创建舍入偏移表和编码器，其在考虑在对于量化后的变换系数值进行逆频率变换之后出现的舍入效应时进行编码决定。

公开(公告)号：US08155195B2

公开(公告)日：2012-04-10

申请号：US11400049

申请日：2006-04-07

Applicant: Shankar Regunathan ,  Chih-Lung Lin ,  Thomas W. Holcomb

Inventor： Shankar Regunathan ,  Chih-Lung Lin ,  Thomas W. Holcomb

IPC: H04B1/66 ,  H04N7/12 ,  H04N11/02 ,  H04N11/04

CPC classification number: H04N19/567

Abstract: Techniques and tools for switching distortion metrics during motion estimation are described. For example, a video encoder determines a distortion metric selection criterion for motion estimation. The criterion can be based on initial results of the motion estimation. To evaluate the criterion, the encoder can compare the criterion to a threshold that depends on a current quantization parameter. The encoder selects between multiple available distortion metrics, which can include a sample-domain distortion metric (e.g., SAD) and a transform-domain distortion metric (e.g., SAHD). The encoder uses the selected distortion metric in the motion estimation. Selectively switching between SAD and SAHD provides rate-distortion performance superior to using only SAD or only SAHD. Moreover, due to the lower complexity of SAD, the computational complexity of motion estimation with SAD-SAHD switching is typically less than motion estimation that always uses SAHD.

Abstract translation: 描述了在运动估计期间切换失真度量的技术和工具。 例如，视频编码器确定用于运动估计的失真度量选择标准。 该标准可以基于运动估计的初始结果。 为了评估标准，编码器可以将标准与​​取决于当前量化参数的阈值进行比较。 编码器在可以包括采样域失真度量（例如SAD）和变换域失真度量（例如，SAHD）的多个可用失真度量之间进行选择。 编码器在运动估计中使用所选择的失真度量。 选择性地切换SAD和SAHD之间的速率失真性能优于仅使用SAD或仅SAHD。 此外，由于SAD的较低的复杂度，SAD-SAHD切换的运动估计的计算复杂度通常小于始终使用SAHD的运动估计。

公开(公告)号：US08059721B2

公开(公告)日：2011-11-15

申请号：US11400719

申请日：2006-04-07

Applicant: Cheng Chang ,  Chih-Lung Lin ,  Shankar Regunathan

Inventor： Cheng Chang ,  Chih-Lung Lin ,  Shankar Regunathan

IPC: H04N7/12

CPC classification number: H04N19/625 ,  H04N19/126 ,  H04N19/61

Abstract: Techniques and tools are described for compensating for rounding when estimating sample-domain distortion in the transform domain. For example, a video encoder estimates pixel-domain distortion in the transform domain for a block of transform coefficients after compensating for rounding in the DC coefficient of the block. In this way, the video encoder improves the accuracy of pixel-domain distortion estimation but retains the computational advantages of performing the estimation in the transform domain. Rounding compensation includes, for example, looking up an index (from a de-quantized transform coefficient) in a rounding offset table to determine a rounding offset, then adjusting the coefficient by the offset. Other techniques and tools described herein are directed to creating rounding offset tables and encoders that make encoding decisions after considering rounding effects that occur after an inverse frequency transform on de-quantized transform coefficient values.

Abstract translation: 描述了在估计变换域中的样本域失真时补偿舍入的技术和工具。 例如，视频编码器在补偿块的DC系数中的舍入后估计变换系数块的变换域中的像素域失真。 以这种方式，视频编码器提高了像素域失真估计的精度，但保留了在变换域中执行估计的计算优点。 舍入补偿包括例如在舍入偏移表中查找索引（来自去量化的变换系数）以确定舍入偏移，然后将系数调整为偏移。 本文描述的其他技术和工具旨在创建舍入偏移表和编码器，其在考虑在对于量化后的变换系数值进行逆频率变换之后出现的舍入效应时进行编码决定。

公开(公告)号：US08054886B2

公开(公告)日：2011-11-08

申请号：US11772070

申请日：2007-06-29

Applicant: Sridhar Srinivasan ,  Chengjie Tu ,  Shankar Regunathan ,  Gary J. Sullivan

Inventor： Sridhar Srinivasan ,  Chengjie Tu ,  Shankar Regunathan ,  Gary J. Sullivan

IPC: H04N7/12 ,  H04N11/02 ,  H04N11/20 ,  H04N7/01

CPC classification number: H04N19/186 ,  H04N19/46 ,  H04N19/63 ,  H04N19/70

Abstract: Rules for the signaling and interpretation of chroma position are described. One rule, called the short rule, defines fifteen discrete chroma centering positions and corresponding four-bit syntax element. Another rule, called the extended rule, defines 81 discrete chroma centering positions and corresponding seven-bit syntax elements. A described method includes receiving digital media data at a digital media encoder, determining chroma position information for the received digital media data, and representing the chroma position information with one or more syntax elements in an encoded bitstream. The one or more syntax elements are operable to communicate the chroma position information to a digital media decoder. The chroma position information facilitates an image rotation or flip.

Abstract translation: 描述色度位置信号和解释规则。 称为短规则的一个规则定义了十五个离散色度对中位置和相应的四位语法元素。 称为扩展规则的另一个规则定义了81个离散色度对中位置和相应的七位语法元素。 所描述的方法包括在数字媒体编码器处接收数字媒体数据，确定接收到的数字媒体数据的色度位置信息，并用编码比特流中的一个或多个语法元素表示色度位置信息。 一个或多个语法元素可操作以将色度位置信息传送到数字媒体解码器。 色度位置信息有助于图像旋转或翻转。

公开(公告)号：US20100092098A1

公开(公告)日：2010-04-15

申请号：US12571365

申请日：2009-09-30

Applicant: DAN SCHONBERG ,  SHANKAR REGUNATHAN ,  SHIJUN SUN ,  GARY J. SULLIVAN ,  ZHI ZHOU ,  SRIDHAR SRINIVASAN

Inventor： DAN SCHONBERG ,  SHANKAR REGUNATHAN ,  SHIJUN SUN ,  GARY J. SULLIVAN ,  ZHI ZHOU ,  SRIDHAR SRINIVASAN

IPC: G06K9/36

CPC classification number: G06F17/147 ,  H04N19/117 ,  H04N19/122 ,  H04N19/14 ,  H04N19/176 ,  H04N19/60 ,  H04N19/86

Abstract: In certain embodiments, overlap operators are applied during encoding and/or decoding of digital media, where the overlap operators have reduced DC gain mismatch and/or DC leakage between interior overlap operators and overlap operators at the edge and/or corner. In other embodiments, information indicating a selected tile boundary option for overlap processing can be encoded and/or decoded. The selected tile boundary option indicates one of a hard tile boundary option and a soft tile boundary option for processing with overlap operators. Overlap transform processing can then be applied based at least in part on the selected tile boundary option.

Abstract translation: 在某些实施例中，在数字媒体的编码和/或解码期间应用重叠运算符，其中重叠运算符在边缘和/或角落处内部重叠运算符和重叠运算符之间具有降低的DC增益失配和/或DC泄漏。 在其他实施例中，可以编码和/或解码指示用于重叠处理的所选择的瓦片边界选项的信息。 所选的瓦片边界选项指示用于使用重叠运算符进行处理的硬瓦片边界选项和软瓦片边界选项之一。 然后可以至少部分地基于所选择的瓦片边界选项来应用重叠变换处理。

公开(公告)号：US20100046612A1

公开(公告)日：2010-02-25

申请号：US12197922

申请日：2008-08-25

Applicant: Shijun Sun ,  Shankar Regunathan ,  Chengjie Tu ,  Chih-Lung Lin

Inventor： Shijun Sun ,  Shankar Regunathan ,  Chengjie Tu ,  Chih-Lung Lin

IPC: H04N7/26

CPC classification number: H04N19/59 ,  H04N19/117 ,  H04N19/149 ,  H04N19/186 ,  H04N19/187 ,  H04N19/33 ,  H04N19/40 ,  H04N19/86

Abstract: Techniques and tools for conversion operations between modules in a scalable video encoding tool or scalable video decoding tool are described. For example, given reconstructed base layer video in a low resolution format (e.g., 4:2:0 video with 8 bits per sample) an encoding tool and decoding tool adaptively filter the reconstructed base layer video and upsample its sample values to a higher sample depth (e.g., 10 bits per sample). The tools also adaptively scale chroma samples to a higher chroma sampling rate (e.g., 4:2:2). The adaptive filtering and chroma scaling help reduce energy in inter-layer residual video by making the reconstructed base layer video closer to input video, which typically makes compression of the inter-layer residual video more efficient. The encoding tool also remaps sample values of the inter-layer residual video to adjust dynamic range before encoding, and the decoding tool performs inverse remapping after decoding.

Abstract translation: 描述了可扩展视频编码工具或可扩展视频解码工具中的模块之间的转换操作的技术和工具。 例如，给定以低分辨率格式的重建基层视频（例如，具有每个样本8位的4：2：0视频），编码工具和解码工具自适应地过滤重建的基层视频并将其样本值上采样到较高的样本 深度（例如每个样本10位）。 这些工具还可以自适应地将色度样本缩放到更高的色度采样率（例如4：2：2）。 自适应滤波和色度缩放有助于通过使重构的基本层视频更接近输入视频来减少层间残留视频中的能量，这通常使得层间残留视频的压缩更有效。 编码工具还重新映射层间残差视频的采样值，以便在编码之前调整动态范围，并且解码工具在解码之后执行反向重新映射。

公开(公告)号：US20090196338A1

公开(公告)日：2009-08-06

申请号：US12026534

申请日：2008-02-05

Applicant: Walid Ali ,  Shankar Regunathan ,  Guo-Wei Shieh ,  Bruce Lin ,  Bharath Siravara ,  Ce Wang

Inventor： Walid Ali ,  Shankar Regunathan ,  Guo-Wei Shieh ,  Bruce Lin ,  Bharath Siravara ,  Ce Wang

IPC: H04B1/66

CPC classification number: H04N19/85

Abstract: Architecture for enhancing the compression (e.g., luma, chroma) of a video signal and improving the perceptual quality of the video compression schemes. The architecture operates to reshape the normal multimodal energy distribution of the input video signal to a new energy distribution. In the context of luma, the algorithm maps the black and white (or contrast) information of a picture to a new energy distribution. For example, the contrast can be enhanced in the middle range of the luma spectrum, thereby improving the contrast between a light foreground object and a dark background. At the same time, the algorithm reduces the bit-rate requirements at a particular quantization step size. The algorithm can be utilized also in post-processing to improve the quality of decoded video.

Abstract translation: 用于增强视频信号的压缩（例如，亮度，色度）并提高视频压缩方案的感知质量的体系结构。 该架构用于将输入视频信号的正常多模态能量分布重新形成新的能量分布。 在亮度的上下文中，该算法将图像的黑白（或对比）信息映射到新的能量分布。 例如，可以在亮度光谱的中间范围内增强对比度，从而改善光前景物体和暗背景之间的对比度。 同时，该算法降低了特定量化步长的比特率要求。 该算法也可用于后处理，以提高解码视频的质量。

公开(公告)号：US20070237226A1

公开(公告)日：2007-10-11

申请号：US11400049

申请日：2006-04-07

Applicant: Shankar Regunathan ,  Chih-Lung Lin ,  Thomas Holcomb

Inventor： Shankar Regunathan ,  Chih-Lung Lin ,  Thomas Holcomb

IPC: H04N7/12 ,  H04B1/66

CPC classification number: H04N19/567

Abstract: Techniques and tools for switching distortion metrics during motion estimation are described. For example, a video encoder determines a distortion metric selection criterion for motion estimation. The criterion can be based on initial results of the motion estimation. To evaluate the criterion, the encoder can compare the criterion to a threshold that depends on a current quantization parameter. The encoder selects between multiple available distortion metrics, which can include a sample-domain distortion metric (e.g., SAD) and a transform-domain distortion metric (e.g., SAHD). The encoder uses the selected distortion metric in the motion estimation. Selectively switching between SAD and SAHD provides rate-distortion performance superior to using only SAD or only SAHD. Moreover, due to the lower complexity of SAD, the computational complexity of motion estimation with SAD-SAHD switching is typically less than motion estimation that always uses SAHD.

Abstract translation: 描述了在运动估计期间切换失真度量的技术和工具。 例如，视频编码器确定用于运动估计的失真度量选择标准。 标准可以基于运动估计的初始结果。 为了评估标准，编码器可以将标准与​​取决于当前量化参数的阈值进行比较。 编码器在可以包括采样域失真度量（例如SAD）和变换域失真度量（例如，SAHD）的多个可用失真度量之间进行选择。 编码器在运动估计中使用所选择的失真度量。 选择性地切换SAD和SAHD之间的速率失真性能优于仅使用SAD或仅SAHD。 此外，由于SAD的较低的复杂度，SAD-SAHD切换的运动估计的计算复杂度通常小于始终使用SAHD的运动估计。

公开(公告)号：US20050152448A1

公开(公告)日：2005-07-14

申请号：US10989843

申请日：2004-11-15

Applicant: Regis Crinon ,  Thomas Holcomb ,  Shankar Regunathan ,  Sridhar Srinivasan

Inventor： Regis Crinon ,  Thomas Holcomb ,  Shankar Regunathan ,  Sridhar Srinivasan

IPC: G11C7/00 ,  H04N5/783 ,  H04N7/12

CPC classification number: H04N21/23424 ,  H04N19/44 ,  H04N19/70 ,  H04N21/44016 ,  H04N21/8455

Abstract: A video decoder receives an entry point key frame comprising first and second interlaced video fields and decodes a first syntax element comprising information (e.g., frame coding mode) for the entry point key frame at a first syntax level (e.g., frame level) in a bitstream. The first interlaced video field is a predicted field, and the second interlaced video field is an intra-coded field. The information for the entry point key frame can be a frame coding mode (e.g., field interlace) for the entry point key frame. The decoder can decode a second syntax element at the first syntax level comprising second information (e.g., field type for each of the first and second interlaced video fields) for the entry point key frame.

Abstract translation: 视频解码器接收包括第一和第二隔行视频字段的入口点关键帧，并且解码第一语法元素，该第一语法元素包括第一语法元素，其包括用于入口点关键帧的信息（例如，帧编码模式） 比特流。 第一隔行视频字段是预测字段，第二隔行视频字段是帧内编码字段。 入口点关键帧的信息可以是用于入口点关键帧的帧编码模式（例如，场交错）。 解码器可以解码第一语法级别的第二语法元素，其包括用于入口点关键帧的第二信息（例如，用于第一和第二隔行扫描视频字段中的每一个的场类型）。