公开(公告)号：US09398314B2

公开(公告)日：2016-07-19

申请号：US12026534

申请日：2008-02-05

Applicant: Walid Ali ,  Shankar Regunathan ,  Guo-Wei Shieh ,  Bruce Lin ,  Bharath Siravara ,  Ce Wang

Inventor： Walid Ali ,  Shankar Regunathan ,  Guo-Wei Shieh ,  Bruce Lin ,  Bharath Siravara ,  Ce Wang

IPC: H04N7/12 ,  H04N19/85

CPC classification number: H04N19/85

Abstract: Architecture for enhancing the compression (e.g., luma, chroma) of a video signal and improving the perceptual quality of the video compression schemes. The architecture operates to reshape the normal multimodal energy distribution of the input video signal to a new energy distribution. In the context of luma, the algorithm maps the black and white (or contrast) information of a picture to a new energy distribution. For example, the contrast can be enhanced in the middle range of the luma spectrum, thereby improving the contrast between a light foreground object and a dark background. At the same time, the algorithm reduces the bit-rate requirements at a particular quantization step size. The algorithm can be utilized also in post-processing to improve the quality of decoded video.

Abstract translation: 用于增强视频信号的压缩（例如，亮度，色度）并提高视频压缩方案的感知质量的体系结构。 该架构用于将输入视频信号的正常多模态能量分布重新形成新的能量分布。 在亮度的上下文中，该算法将图像的黑白（或对比）信息映射到新的能量分布。 例如，可以在亮度光谱的中间范围内增强对比度，从而改善光前景物体和暗背景之间的对比度。 同时，该算法降低了特定量化步长的比特率要求。 该算法也可用于后处理，以提高解码视频的质量。

公开(公告)号：US20120243615A1

公开(公告)日：2012-09-27

申请号：US13458774

申请日：2012-04-27

Applicant: Chengjie Tu ,  Shankar Regunathan ,  Shijun Sun ,  Chih-Lung Lin

Inventor： Chengjie Tu ,  Shankar Regunathan ,  Shijun Sun ,  Chih-Lung Lin

IPC: H04N7/26

CPC classification number: H04N19/174 ,  G06T9/005 ,  H04N19/129 ,  H04N19/13 ,  H04N19/132 ,  H04N19/136 ,  H04N19/15 ,  H04N19/152 ,  H04N19/162 ,  H04N19/172 ,  H04N19/176 ,  H04N19/40 ,  H04N19/44 ,  H04N19/46 ,  H04N19/61 ,  H04N19/91

Abstract: Techniques and tools for encoding and decoding a block of frequency coefficients are presented. An encoder selects a scan order from multiple available scan orders and then applies the selected scan order to a two-dimensional matrix of transform coefficients, grouping non-zero values of the frequency coefficients together in a one-dimensional string. The encoder entropy encodes the one-dimensional string of coefficient values according to a multi-level nested set representation. In decoding, a decoder entropy decodes the one-dimensional string of coefficient values from the multi-level nested set representation. The decoder selects the scan order from among multiple available scan orders and then reorders the coefficients back into a two-dimensional matrix using the selected scan order.

Abstract translation: 提出了用于编码和解码频率系数块的技术和工具。 编码器从多个可用扫描顺序中选择扫描顺序，然后将所选择的扫描顺序应用于变换系数的二维矩阵，将频率系数的非零值在一维串中分组。 编码器根据多级嵌套集合表示对一维系列值串进行编码。 在解码中，解码器熵从多级嵌套集合表示解码系数值的一维串。 解码器从多个可用扫描顺序中选择扫描顺序，然后使用所选择的扫描顺序将系数重新排序成二维矩阵。

公开(公告)号：US08213503B2

公开(公告)日：2012-07-03

申请号：US12205689

申请日：2008-09-05

Applicant: Chengjie Tu ,  Shankar Regunathan ,  Shijun Sun ,  Chih-Lung Lin

Inventor： Chengjie Tu ,  Shankar Regunathan ,  Shijun Sun ,  Chih-Lung Lin

IPC: H04N7/12

CPC classification number: H04N21/234381 ,  H04N19/103 ,  H04N19/132 ,  H04N19/147 ,  H04N19/176 ,  H04N19/187 ,  H04N19/33 ,  H04N19/51 ,  H04N19/61 ,  H04N21/2383

Abstract: Techniques and tools for skip modes in encoding and decoding of inter-layer residual video are described. For example, an encoder encodes multiple macroblocks of a picture of inter-layer residual video. For a current macroblock that is skipped, the encoder selects a skip mode from among multiple available skip modes and uses the selected skip mode when encoding the current macroblock. The skip modes can include intra skip mode and predicted-motion skip mode. A corresponding decoder, for the current macroblock, selects and uses the skip mode for the current macroblock during decoding. As another example, an encoder encodes multiple channels of a picture of inter-layer residual video. For each channel, the encoder determines whether to skip the channel. The encoder signals channel skip information to indicate which channels are skipped. A corresponding decoder parses the channel skip information and determines on a channel-by-channel basis whether to skip the respective channels.

Abstract translation: 描述了层间残差视频编码和解码中跳过模式的技术和工具。 例如，编码器编码层间残留视频的图像的多个宏块。 对于跳过的当前宏块，编码器从多个可用跳过模式中选择跳过模式，并且在对当前宏块进行编码时使用所选择的跳过模式。 跳过模式可以包括帧内跳过模式和预测运动跳过模式。 对于当前宏块，对应的解码器在解码期间选择并使用当前宏块的跳过模式。 作为另一示例，编码器对层间残留视频的图像的多个信道进行编码。 对于每个通道，编码器确定是否跳过通道。 编码器信号通道跳过信息以指示哪些通道被跳过。 相应的解码器解析信道跳过信息，并且逐个信道地确定是否跳过相应的信道。

公开(公告)号：US20120020409A1

公开(公告)日：2012-01-26

申请号：US13248784

申请日：2011-09-29

Applicant: Cheng Chang ,  Chih-Lung B. Lin ,  Shankar Regunathan

Inventor： Cheng Chang ,  Chih-Lung B. Lin ,  Shankar Regunathan

IPC: H04N7/26

CPC classification number: H04N19/625 ,  H04N19/126 ,  H04N19/61

Abstract: Techniques and tools are described for compensating for rounding when estimating sample-domain distortion in the transform domain. For example, a video encoder estimates pixel-domain distortion in the transform domain for a block of transform coefficients after compensating for rounding in the DC coefficient of the block. In this way, the video encoder improves the accuracy of pixel-domain distortion estimation but retains the computational advantages of performing the estimation in the transform domain. Rounding compensation includes, for example, looking up an index (from a de-quantized transform coefficient) in a rounding offset table to determine a rounding offset, then adjusting the coefficient by the offset. Other techniques and tools described herein are directed to creating rounding offset tables and encoders that make encoding decisions after considering rounding effects that occur after an inverse frequency transform on de-quantized transform coefficient values.

Abstract translation: 描述了在估计变换域中的样本域失真时补偿舍入的技术和工具。 例如，视频编码器在补偿块的DC系数中的舍入后估计变换系数块的变换域中的像素域失真。 以这种方式，视频编码器提高了像素域失真估计的精度，但保留了在变换域中执行估计的计算优点。 舍入补偿包括例如在舍入偏移表中查找索引（来自去量化的变换系数）以确定舍入偏移，然后将系数调整为偏移。 本文描述的其他技术和工具旨在创建舍入偏移表和编码器，其在考虑在对于量化后的变换系数值进行逆频率变换之后出现的舍入效应时进行编码决定。

公开(公告)号：US20100280827A1

公开(公告)日：2010-11-04

申请号：US12433143

申请日：2009-04-30

Applicant: Kunal Mukerjee ,  Kazuhito Koishida ,  Shankar Regunathan

Inventor： Kunal Mukerjee ,  Kazuhito Koishida ,  Shankar Regunathan

IPC: G10L15/00

CPC classification number: G10L15/142 ,  G10L15/16 ,  G10L15/197 ,  G10L15/20 ,  G10L21/0208 ,  G10L21/0216 ,  G10L25/18 ,  G10L25/93

Abstract: Embodiments for implementing a speech recognition system that includes a speech classifier ensemble are disclosed. In accordance with one embodiment, the speech recognition system includes a classifier ensemble to convert feature vectors that represent a speech vector into log probability sets. The classifier ensemble includes a plurality of classifiers. The speech recognition system includes a decoder ensemble to transform the log probability sets into output symbol sequences. The speech recognition system further includes a query component to retrieve one or more speech utterances from a speech database using the output symbol sequences.

Abstract translation: 公开了实现包括语音分类器集合的语音识别系统的实施例。 根据一个实施例，语音识别系统包括将表示语音向量的特征向量转换为对数概率集的分类器集合。 分类器集合包括多个分类器。 语音识别系统包括将对数概率集合变换为输出符号序列的解码器集合。 该语音识别系统还包括一个查询组件，用于使用输出符号序列从语音数据库中检索一个或多个语音话语。

公开(公告)号：US20100061447A1

公开(公告)日：2010-03-11

申请号：US12205689

申请日：2008-09-05

Applicant: Chengjie Tu ,  Shankar Regunathan ,  Shijun Sun ,  Chih-Lung Lin

Inventor： Chengjie Tu ,  Shankar Regunathan ,  Shijun Sun ,  Chih-Lung Lin

IPC: H04N7/12

CPC classification number: H04N21/234381 ,  H04N19/103 ,  H04N19/132 ,  H04N19/147 ,  H04N19/176 ,  H04N19/187 ,  H04N19/33 ,  H04N19/51 ,  H04N19/61 ,  H04N21/2383

Abstract: Techniques and tools for skip modes in encoding and decoding of inter-layer residual video are described. For example, an encoder encodes multiple macroblocks of a picture of inter-layer residual video. For a current macroblock that is skipped, the encoder selects a skip mode from among multiple available skip modes and uses the selected skip mode when encoding the current macroblock. The skip modes can include intra skip mode and predicted-motion skip mode. A corresponding decoder, for the current macroblock, selects and uses the skip mode for the current macroblock during decoding. As another example, an encoder encodes multiple channels of a picture of inter-layer residual video. For each channel, the encoder determines whether to skip the channel. The encoder signals channel skip information to indicate which channels are skipped. A corresponding decoder parses the channel skip information and determines on a channel-by-channel basis whether to skip the respective channels.

Abstract translation: 描述了层间残差视频编码和解码中跳过模式的技术和工具。 例如，编码器编码层间残留视频的图像的多个宏块。 对于跳过的当前宏块，编码器从多个可用跳过模式中选择跳过模式，并且在对当前宏块进行编码时使用所选择的跳过模式。 跳过模式可以包括帧内跳过模式和预测运动跳过模式。 对于当前宏块，对应的解码器在解码期间选择并使用当前宏块的跳过模式。 作为另一示例，编码器对层间残留视频的图像的多个信道进行编码。 对于每个通道，编码器确定是否跳过通道。 编码器信号通道跳过信息以指示哪些通道被跳过。 相应的解码器解析信道跳过信息，并且逐个信道地确定是否跳过相应的信道。

公开(公告)号：US20060146830A1

公开(公告)日：2006-07-06

申请号：US11027294

申请日：2004-12-30

Applicant: Chih-Lung Lin ,  Minghui Xia ,  Pohsiang Hsu ,  Shankar Regunathan ,  Thomas Holcomb

Inventor： Chih-Lung Lin ,  Minghui Xia ,  Pohsiang Hsu ,  Shankar Regunathan ,  Thomas Holcomb

IPC: H04L12/56 ,  H04J3/24

CPC classification number: H04N19/89 ,  H04N19/103 ,  H04N19/124 ,  H04N19/166 ,  H04N19/172 ,  H04N19/188 ,  H04N19/46 ,  H04N19/573 ,  H04N19/61 ,  H04N19/91

Abstract: Various new and non-obvious apparatus and methods for using frame caching to improve packet loss recovery are disclosed. One of the disclosed embodiments is a method for using periodical and synchronized frame caching within an encoder and its corresponding decoder. When the decoder discovers packet loss, it informs the encoder which then generates a frame based on one of the shared frames stored at both the encoder and the decoder. When the decoder receives this generated frame it can decode it using its locally cached frame.

Abstract translation: 公开了使用帧缓存来改善丢包恢复的各种新的和不明显的装置和方法。 所公开的实施例之一是用于在编码器及其对应的解码器内使用周期性和同步帧缓存的方法。 当解码器发现分组丢失时，它通知编码器，然后编码器基于存储在编码器和解码器的共享帧之一来生成帧。 当解码器接收到该生成的帧时，它可以使用其本地缓存的帧进行解码。

公开(公告)号：US09571856B2

公开(公告)日：2017-02-14

申请号：US12197922

申请日：2008-08-25

Applicant: Shijun Sun ,  Shankar Regunathan ,  Chengjie Tu ,  Chih-Lung Lin

Inventor： Shijun Sun ,  Shankar Regunathan ,  Chengjie Tu ,  Chih-Lung Lin

IPC: H04N7/12 ,  H04N19/59 ,  H04N19/149 ,  H04N19/117 ,  H04N19/186 ,  H04N19/187 ,  H04N19/33 ,  H04N19/86 ,  H04N19/40

CPC classification number: H04N19/59 ,  H04N19/117 ,  H04N19/149 ,  H04N19/186 ,  H04N19/187 ,  H04N19/33 ,  H04N19/40 ,  H04N19/86

Abstract: Techniques and tools for conversion operations between modules in a scalable video encoding tool or scalable video decoding tool are described. For example, given reconstructed base layer video in a low resolution format (e.g., 4:2:0 video with 8 bits per sample) an encoding tool and decoding tool adaptively filter the reconstructed base layer video and upsample its sample values to a higher sample depth (e.g., 10 bits per sample). The tools also adaptively scale chroma samples to a higher chroma sampling rate (e.g., 4:2:2). The adaptive filtering and chroma scaling help reduce energy in inter-layer residual video by making the reconstructed base layer video closer to input video, which typically makes compression of the inter-layer residual video more efficient. The encoding tool also remaps sample values of the inter-layer residual video to adjust dynamic range before encoding, and the decoding tool performs inverse remapping after decoding.

Abstract translation: 描述了可扩展视频编码工具或可扩展视频解码工具中的模块之间的转换操作的技术和工具。 例如，给定以低分辨率格式的重建基层视频（例如，具有每个样本8位的4：2：0视频），编码工具和解码工具自适应地过滤重建的基层视频并将其样本值上采样到较高的样本 深度（例如每个样本10位）。 这些工具还可以自适应地将色度样本缩放到更高的色度采样率（例如4：2：2）。 自适应滤波和色度缩放有助于通过使重构的基本层视频更接近输入视频来减少层间残留视频中的能量，这通常使得层间残留视频的压缩更有效。 编码工具还重新映射层间残差视频的采样值，以便在编码之前调整动态范围，并且解码工具在解码之后执行反向重新映射。

公开(公告)号：US09313501B2

公开(公告)日：2016-04-12

申请号：US13614453

申请日：2012-09-13

Applicant: Chih-Lung Lin ,  Minghui Xia ,  Pohsiang Hsu ,  Shankar Regunathan ,  Thomas W. Holcomb

Inventor： Chih-Lung Lin ,  Minghui Xia ,  Pohsiang Hsu ,  Shankar Regunathan ,  Thomas W. Holcomb

IPC: H04N19/164 ,  H04N19/89 ,  H04N19/172 ,  H04N19/46 ,  H04N19/61 ,  H04N19/103 ,  H04N19/166 ,  H04N19/573 ,  H04N19/169

CPC classification number: H04N19/89 ,  H04N19/103 ,  H04N19/124 ,  H04N19/166 ,  H04N19/172 ,  H04N19/188 ,  H04N19/46 ,  H04N19/573 ,  H04N19/61 ,  H04N19/91

Abstract: Various new and non-obvious apparatus and methods for using frame caching to improve packet loss recovery are disclosed. One of the disclosed embodiments is a method for using periodical and synchronized frame caching within an encoder and its corresponding decoder. When the decoder discovers packet loss, it informs the encoder which then generates a frame based on one of the shared frames stored at both the encoder and the decoder. When the decoder receives this generated frame it can decode it using its locally cached frame.

公开(公告)号：US08634413B2

公开(公告)日：2014-01-21

申请号：US11027294

申请日：2004-12-30

Applicant: Chih-Lung Lin ,  Minghui Xia ,  Pohsiang Hsu ,  Shankar Regunathan ,  Thomas W. Holcomb

Inventor： Chih-Lung Lin ,  Minghui Xia ,  Pohsiang Hsu ,  Shankar Regunathan ,  Thomas W. Holcomb

IPC: H04L12/26

CPC classification number: H04N19/89 ,  H04N19/103 ,  H04N19/124 ,  H04N19/166 ,  H04N19/172 ,  H04N19/188 ,  H04N19/46 ,  H04N19/573 ,  H04N19/61 ,  H04N19/91

Abstract: Various new and non-obvious apparatus and methods for using frame caching to improve packet loss recovery are disclosed. One of the disclosed embodiments is a method for using periodical and synchronized frame caching within an encoder and its corresponding decoder. When the decoder discovers packet loss, it informs the encoder which then generates a frame based on one of the shared frames stored at both the encoder and the decoder. When the decoder receives this generated frame it can decode it using its locally cached frame.

Abstract translation: 公开了使用帧缓存来改善丢包恢复的各种新的和不明显的装置和方法。 所公开的实施例之一是用于在编码器及其对应的解码器内使用周期性和同步帧缓存的方法。 当解码器发现分组丢失时，它通知编码器，然后编码器基于存储在编码器和解码器的共享帧之一来生成帧。 当解码器接收到该生成的帧时，它可以使用其本地缓存的帧进行解码。