公开(公告)号：US08249145B2

公开(公告)日：2012-08-21

申请号：US13248784

申请日：2011-09-29

Applicant: Cheng Chang ,  Chih-Lung B. Lin ,  Shankar Regunathan

Inventor： Cheng Chang ,  Chih-Lung B. Lin ,  Shankar Regunathan

IPC: H04N7/12

CPC classification number: H04N19/625 ,  H04N19/126 ,  H04N19/61

Abstract: Techniques and tools are described for compensating for rounding when estimating sample-domain distortion in the transform domain. For example, a video encoder estimates pixel-domain distortion in the transform domain for a block of transform coefficients after compensating for rounding in the DC coefficient of the block. In this way, the video encoder improves the accuracy of pixel-domain distortion estimation but retains the computational advantages of performing the estimation in the transform domain. Rounding compensation includes, for example, looking up an index (from a de-quantized transform coefficient) in a rounding offset table to determine a rounding offset, then adjusting the coefficient by the offset. Other techniques and tools described herein are directed to creating rounding offset tables and encoders that make encoding decisions after considering rounding effects that occur after an inverse frequency transform on de-quantized transform coefficient values.

Abstract translation: 描述了在估计变换域中的样本域失真时补偿舍入的技术和工具。 例如，视频编码器在补偿块的DC系数中的舍入后估计变换系数块的变换域中的像素域失真。 以这种方式，视频编码器提高了像素域失真估计的精度，但保留了在变换域中执行估计的计算优点。 舍入补偿包括例如在舍入偏移表中查找索引（来自去量化的变换系数）以确定舍入偏移，然后将系数调整为偏移。 本文描述的其他技术和工具旨在创建舍入偏移表和编码器，其在考虑在对于量化后的变换系数值进行逆频率变换之后出现的舍入效应时进行编码决定。

公开(公告)号：US08155195B2

公开(公告)日：2012-04-10

申请号：US11400049

申请日：2006-04-07

Applicant: Shankar Regunathan ,  Chih-Lung Lin ,  Thomas W. Holcomb

Inventor： Shankar Regunathan ,  Chih-Lung Lin ,  Thomas W. Holcomb

IPC: H04B1/66 ,  H04N7/12 ,  H04N11/02 ,  H04N11/04

CPC classification number: H04N19/567

Abstract: Techniques and tools for switching distortion metrics during motion estimation are described. For example, a video encoder determines a distortion metric selection criterion for motion estimation. The criterion can be based on initial results of the motion estimation. To evaluate the criterion, the encoder can compare the criterion to a threshold that depends on a current quantization parameter. The encoder selects between multiple available distortion metrics, which can include a sample-domain distortion metric (e.g., SAD) and a transform-domain distortion metric (e.g., SAHD). The encoder uses the selected distortion metric in the motion estimation. Selectively switching between SAD and SAHD provides rate-distortion performance superior to using only SAD or only SAHD. Moreover, due to the lower complexity of SAD, the computational complexity of motion estimation with SAD-SAHD switching is typically less than motion estimation that always uses SAHD.

Abstract translation: 描述了在运动估计期间切换失真度量的技术和工具。 例如，视频编码器确定用于运动估计的失真度量选择标准。 该标准可以基于运动估计的初始结果。 为了评估标准，编码器可以将标准与​​取决于当前量化参数的阈值进行比较。 编码器在可以包括采样域失真度量（例如SAD）和变换域失真度量（例如，SAHD）的多个可用失真度量之间进行选择。 编码器在运动估计中使用所选择的失真度量。 选择性地切换SAD和SAHD之间的速率失真性能优于仅使用SAD或仅SAHD。 此外，由于SAD的较低的复杂度，SAD-SAHD切换的运动估计的计算复杂度通常小于始终使用SAHD的运动估计。

公开(公告)号：US08059721B2

公开(公告)日：2011-11-15

申请号：US11400719

申请日：2006-04-07

Applicant: Cheng Chang ,  Chih-Lung Lin ,  Shankar Regunathan

Inventor： Cheng Chang ,  Chih-Lung Lin ,  Shankar Regunathan

IPC: H04N7/12

CPC classification number: H04N19/625 ,  H04N19/126 ,  H04N19/61

Abstract: Techniques and tools are described for compensating for rounding when estimating sample-domain distortion in the transform domain. For example, a video encoder estimates pixel-domain distortion in the transform domain for a block of transform coefficients after compensating for rounding in the DC coefficient of the block. In this way, the video encoder improves the accuracy of pixel-domain distortion estimation but retains the computational advantages of performing the estimation in the transform domain. Rounding compensation includes, for example, looking up an index (from a de-quantized transform coefficient) in a rounding offset table to determine a rounding offset, then adjusting the coefficient by the offset. Other techniques and tools described herein are directed to creating rounding offset tables and encoders that make encoding decisions after considering rounding effects that occur after an inverse frequency transform on de-quantized transform coefficient values.

Abstract translation: 描述了在估计变换域中的样本域失真时补偿舍入的技术和工具。 例如，视频编码器在补偿块的DC系数中的舍入后估计变换系数块的变换域中的像素域失真。 以这种方式，视频编码器提高了像素域失真估计的精度，但保留了在变换域中执行估计的计算优点。 舍入补偿包括例如在舍入偏移表中查找索引（来自去量化的变换系数）以确定舍入偏移，然后将系数调整为偏移。 本文描述的其他技术和工具旨在创建舍入偏移表和编码器，其在考虑在对于量化后的变换系数值进行逆频率变换之后出现的舍入效应时进行编码决定。

公开(公告)号：US20100046612A1

公开(公告)日：2010-02-25

申请号：US12197922

申请日：2008-08-25

Applicant: Shijun Sun ,  Shankar Regunathan ,  Chengjie Tu ,  Chih-Lung Lin

Inventor： Shijun Sun ,  Shankar Regunathan ,  Chengjie Tu ,  Chih-Lung Lin

IPC: H04N7/26

CPC classification number: H04N19/59 ,  H04N19/117 ,  H04N19/149 ,  H04N19/186 ,  H04N19/187 ,  H04N19/33 ,  H04N19/40 ,  H04N19/86

Abstract: Techniques and tools for conversion operations between modules in a scalable video encoding tool or scalable video decoding tool are described. For example, given reconstructed base layer video in a low resolution format (e.g., 4:2:0 video with 8 bits per sample) an encoding tool and decoding tool adaptively filter the reconstructed base layer video and upsample its sample values to a higher sample depth (e.g., 10 bits per sample). The tools also adaptively scale chroma samples to a higher chroma sampling rate (e.g., 4:2:2). The adaptive filtering and chroma scaling help reduce energy in inter-layer residual video by making the reconstructed base layer video closer to input video, which typically makes compression of the inter-layer residual video more efficient. The encoding tool also remaps sample values of the inter-layer residual video to adjust dynamic range before encoding, and the decoding tool performs inverse remapping after decoding.

Abstract translation: 描述了可扩展视频编码工具或可扩展视频解码工具中的模块之间的转换操作的技术和工具。 例如，给定以低分辨率格式的重建基层视频（例如，具有每个样本8位的4：2：0视频），编码工具和解码工具自适应地过滤重建的基层视频并将其样本值上采样到较高的样本 深度（例如每个样本10位）。 这些工具还可以自适应地将色度样本缩放到更高的色度采样率（例如4：2：2）。 自适应滤波和色度缩放有助于通过使重构的基本层视频更接近输入视频来减少层间残留视频中的能量，这通常使得层间残留视频的压缩更有效。 编码工具还重新映射层间残差视频的采样值，以便在编码之前调整动态范围，并且解码工具在解码之后执行反向重新映射。

公开(公告)号：US20090196338A1

公开(公告)日：2009-08-06

申请号：US12026534

申请日：2008-02-05

Applicant: Walid Ali ,  Shankar Regunathan ,  Guo-Wei Shieh ,  Bruce Lin ,  Bharath Siravara ,  Ce Wang

Inventor： Walid Ali ,  Shankar Regunathan ,  Guo-Wei Shieh ,  Bruce Lin ,  Bharath Siravara ,  Ce Wang

IPC: H04B1/66

CPC classification number: H04N19/85

Abstract: Architecture for enhancing the compression (e.g., luma, chroma) of a video signal and improving the perceptual quality of the video compression schemes. The architecture operates to reshape the normal multimodal energy distribution of the input video signal to a new energy distribution. In the context of luma, the algorithm maps the black and white (or contrast) information of a picture to a new energy distribution. For example, the contrast can be enhanced in the middle range of the luma spectrum, thereby improving the contrast between a light foreground object and a dark background. At the same time, the algorithm reduces the bit-rate requirements at a particular quantization step size. The algorithm can be utilized also in post-processing to improve the quality of decoded video.

Abstract translation: 用于增强视频信号的压缩（例如，亮度，色度）并提高视频压缩方案的感知质量的体系结构。 该架构用于将输入视频信号的正常多模态能量分布重新形成新的能量分布。 在亮度的上下文中，该算法将图像的黑白（或对比）信息映射到新的能量分布。 例如，可以在亮度光谱的中间范围内增强对比度，从而改善光前景物体和暗背景之间的对比度。 同时，该算法降低了特定量化步长的比特率要求。 该算法也可用于后处理，以提高解码视频的质量。

公开(公告)号：US20070237226A1

公开(公告)日：2007-10-11

申请号：US11400049

申请日：2006-04-07

Applicant: Shankar Regunathan ,  Chih-Lung Lin ,  Thomas Holcomb

Inventor： Shankar Regunathan ,  Chih-Lung Lin ,  Thomas Holcomb

IPC: H04N7/12 ,  H04B1/66

CPC classification number: H04N19/567

Abstract: Techniques and tools for switching distortion metrics during motion estimation are described. For example, a video encoder determines a distortion metric selection criterion for motion estimation. The criterion can be based on initial results of the motion estimation. To evaluate the criterion, the encoder can compare the criterion to a threshold that depends on a current quantization parameter. The encoder selects between multiple available distortion metrics, which can include a sample-domain distortion metric (e.g., SAD) and a transform-domain distortion metric (e.g., SAHD). The encoder uses the selected distortion metric in the motion estimation. Selectively switching between SAD and SAHD provides rate-distortion performance superior to using only SAD or only SAHD. Moreover, due to the lower complexity of SAD, the computational complexity of motion estimation with SAD-SAHD switching is typically less than motion estimation that always uses SAHD.

Abstract translation: 描述了在运动估计期间切换失真度量的技术和工具。 例如，视频编码器确定用于运动估计的失真度量选择标准。 标准可以基于运动估计的初始结果。 为了评估标准，编码器可以将标准与​​取决于当前量化参数的阈值进行比较。 编码器在可以包括采样域失真度量（例如SAD）和变换域失真度量（例如，SAHD）的多个可用失真度量之间进行选择。 编码器在运动估计中使用所选择的失真度量。 选择性地切换SAD和SAHD之间的速率失真性能优于仅使用SAD或仅SAHD。 此外，由于SAD的较低的复杂度，SAD-SAHD切换的运动估计的计算复杂度通常小于始终使用SAHD的运动估计。

公开(公告)号：US08761243B2

公开(公告)日：2014-06-24

申请号：US12562583

申请日：2009-09-18

Applicant: Kenneth Rose ,  Rui Zhang ,  Shankar Regunathan

Inventor： Kenneth Rose ,  Rui Zhang ,  Shankar Regunathan

IPC: H04N7/12

CPC classification number: H04N21/2404 ,  H04N19/102 ,  H04N19/147 ,  H04N19/177 ,  H04N19/188 ,  H04N19/19 ,  H04N19/194 ,  H04N19/30 ,  H04N19/40 ,  H04N19/61 ,  H04N19/65 ,  H04N19/67 ,  H04N19/89 ,  H04N21/234 ,  H04N21/235 ,  H04N21/435 ,  H04N21/6377 ,  H04N21/6473 ,  H04N21/64769 ,  H04N21/658

Abstract: A method is described for efficiently determining total end-to-end distortion of a pre-compressed data stream, such as video streams or other media streams, at the time of delivery over a lossy-network, and for providing adaptive error-resilient delivery schemes based on distortion estimates. The methods can be utilized with single or multilayer packet streams and are particularly well suited for video streams. By way of example, distortion estimates are performed by generating side-information at the time of data stream compression, wherein the side-information is used in conjunction with information about the network status to determine an estimated distortion for the group of packets when the data stream is transported over the network to a destination end. This estimation may be utilized within described resiliency techniques in which the error correction mechanism is selected in response to the estimated distortion, which may be additionally refined in reference to cost factors.

Abstract translation: 描述了一种用于在通过有损网络传送时有效地确定预压缩数据流（例如视频流或其他媒体流）的总端对端失真的方法，并且用于提供自适应的错误弹性传递 基于失真估计的方案。 这些方法可以用于单个或多个分组流，并且特别适合于视频流。 作为示例，通过在数据流压缩时生成旁侧信息来执行失真估计，其中，侧信息结合关于网络状态的信息使用，以确定数据组的估计失真 流通过网络传输到目的地端。 可以在所述的弹性技术中使用该估计，其中响应于估计的失真来选择纠错机制，这可以参考成本因素进一步细化。

公开(公告)号：US20130010861A1

公开(公告)日：2013-01-10

申请号：US13614453

申请日：2012-09-13

Applicant: Chih-Lung Lin ,  Minghui Xia ,  Pohsiang Hsu ,  Shankar Regunathan ,  Thomas W. Holcomb

Inventor： Chih-Lung Lin ,  Minghui Xia ,  Pohsiang Hsu ,  Shankar Regunathan ,  Thomas W. Holcomb

IPC: H04N7/32 ,  H04N7/26

CPC classification number: H04N19/89 ,  H04N19/103 ,  H04N19/124 ,  H04N19/166 ,  H04N19/172 ,  H04N19/188 ,  H04N19/46 ,  H04N19/573 ,  H04N19/61 ,  H04N19/91

Abstract: Various new and non-obvious apparatus and methods for using frame caching to improve packet loss recovery are disclosed. One of the disclosed embodiments is a method for using periodical and synchronized frame caching within an encoder and its corresponding decoder. When the decoder discovers packet loss, it informs the encoder which then generates a frame based on one of the shared frames stored at both the encoder and the decoder. When the decoder receives this generated frame it can decode it using its locally cached frame.

Abstract translation: 公开了使用帧缓存来改善丢包恢复的各种新的和不明显的装置和方法。 所公开的实施例之一是用于在编码器及其对应的解码器内使用周期性和同步帧缓存的方法。 当解码器发现分组丢失时，它通知编码器，然后编码器基于存储在编码器和解码器的共享帧之一来生成帧。 当解码器接收到该生成的帧时，它可以使用其本地缓存的帧进行解码。

公开(公告)号：US08179974B2

公开(公告)日：2012-05-15

申请号：US12151069

申请日：2008-05-02

Applicant: Chengjie Tu ,  Shankar Regunathan ,  Shijun Sun ,  Chih-Lung Lin

Inventor： Chengjie Tu ,  Shankar Regunathan ,  Shijun Sun ,  Chih-Lung Lin

IPC: H04B1/66

CPC classification number: H04N19/174 ,  G06T9/005 ,  H04N19/129 ,  H04N19/13 ,  H04N19/132 ,  H04N19/136 ,  H04N19/15 ,  H04N19/152 ,  H04N19/162 ,  H04N19/172 ,  H04N19/176 ,  H04N19/40 ,  H04N19/44 ,  H04N19/46 ,  H04N19/61 ,  H04N19/91

Abstract: Techniques and tools for encoding and decoding a block of frequency coefficients are presented. An encoder selects a scan order from multiple available scan orders and then applies the selected scan order to a two-dimensional matrix of transform coefficients, grouping non-zero values of the frequency coefficients together in a one-dimensional string. The encoder entropy encodes the one-dimensional string of coefficient values according to a multi-level nested set representation. In decoding, a decoder entropy decodes the one-dimensional string of coefficient values from the multi-level nested set representation. The decoder selects the scan order from among multiple available scan orders and then reorders the coefficients back into a two-dimensional matrix using the selected scan order.

Abstract translation: 提出了用于编码和解码频率系数块的技术和工具。 编码器从多个可用扫描顺序中选择扫描顺序，然后将所选择的扫描顺序应用于变换系数的二维矩阵，将频率系数的非零值在一维串中分组。 编码器根据多级嵌套集合表示对一维系列值串进行编码。 在解码中，解码器熵从多级嵌套集合表示解码系数值的一维串。 解码器从多个可用扫描顺序中选择扫描顺序，然后使用所选择的扫描顺序将系数重新排序成二维矩阵。

公开(公告)号：US08107531B2

公开(公告)日：2012-01-31

申请号：US10987521

申请日：2004-11-12

Applicant: Shankar Regunathan ,  Chih-Lung Lin ,  Thomas W. Holcomb ,  Jie Liang ,  Ming-Chieh Lee ,  Pohsiang Hsu

Inventor： Shankar Regunathan ,  Chih-Lung Lin ,  Thomas W. Holcomb ,  Jie Liang ,  Ming-Chieh Lee ,  Pohsiang Hsu

IPC: H04N7/12

CPC classification number: H04N19/86 ,  H04N19/117 ,  H04N19/124 ,  H04N19/13 ,  H04N19/146 ,  H04N19/152 ,  H04N19/159 ,  H04N19/16 ,  H04N19/172 ,  H04N19/176 ,  H04N19/179 ,  H04N19/184 ,  H04N19/46 ,  H04N19/51 ,  H04N19/523 ,  H04N19/61 ,  H04N19/70 ,  H04N19/82

Abstract: A video codec efficiently signals that a frame is identical to its reference frame, such that separate coding of its picture content is skipped. Information that a frame is skipped is represented jointly in a coding table of a frame coding type element for bit rate efficiency in signaling. Further, the video codec signals the picture type (e.g., progressive or interlaced) of skipped frames, which permits different repeat padding methods to be applied according to the picture type.

Abstract translation: 视频编解码器有效地发信号通知帧与其参考帧相同，从而跳过其图像内容的单独编码。 帧跳过的信息在信令中的比特率效率的帧编码型元件的编码表中联合表示。 此外，视频编解码器针对跳过的帧的图像类型（例如，逐行或隔行扫描）进行信号，这允许根据图像类型应用不同的重复填充方法。