公开(公告)号：US08233544B2

公开(公告)日：2012-07-31

申请号：US11776679

申请日：2007-07-12

申请人： Yiliang Bao ,  Narendranath Malayath ,  Sharath Manjunath ,  Yan Ye

发明人： Yiliang Bao ,  Narendranath Malayath ,  Sharath Manjunath ,  Yan Ye

IPC分类号： H04N7/12 ,  H04N11/02

CPC分类号： H04N19/34

摘要： The disclosure describes FGS video coding techniques that use cycle-aligned fragments (CAFs). The techniques may perform cycle-based coding of FGS video data block coefficients and syntax elements, and encapsulate cycles in fragments for transmission. The fragments may be cycle-aligned such that a start of a payload of each of the fragments substantially coincides with a start of one of the cycles. In this manner, cycles can be readily accessed via individual fragments. Some cycles may be controlled with a vector mode to scan to a predefined position within a block before moving to another block. In this manner, the number of cycles can be reduced, reducing the number of fragments and associated overhead. The CAFs may be entropy coded independently of one another so that each fragment may be readily accessed and decoded without waiting for decoding of other fragments. Independent entropy coding may permit parallel decoding and simultaneous processing of fragments.

摘要翻译： 本公开描述了使用循环对准片段（CAF）的FGS视频编码技术。 这些技术可以执行FGS视频数据块系数和语法元素的基于循环的编码，并且将循环封装成用于传输的片段。 片段可以是循环对齐的，使得每个片段的有效载荷的开始基本上与循环中的一个的开始重合。 以这种方式，可以容易地通过各个片段访问周期。 可以通过向量模式来控制一些周期，以便在移动到另一个块之前扫描到块内的预定位置。 以这种方式，可以减少周期数，减少片段的数量和相关的开销。 CAF可以彼此独立地进行熵编码，使得每个片段可以容易地被访问和解码，而不等待其他片段的解码。 独立熵编码可以允许并行解码和片段的同时处理。

公开(公告)号：US20060120612A1

公开(公告)日：2006-06-08

申请号：US11008699

申请日：2004-12-08

申请人： Sharath Manjunath ,  Hsiang-Tsun Li ,  Narendranath Malayath

发明人： Sharath Manjunath ,  Hsiang-Tsun Li ,  Narendranath Malayath

IPC分类号： G06K9/36

CPC分类号： H04N19/53 ,  H04N19/56

摘要： This disclosure describes video encoding techniques and video encoding devices that implement such techniques. In one embodiment, this disclosure describes a video encoding device comprising a motion estimator that computes a motion vector predictor based on motion vectors previously calculated for video blocks in proximity to a current video block to be encoded, and uses the motion vector predictor in searching for a prediction video block used to encode the current video block, and a motion compensator that generates a difference block indicative of differences between the current video block to be encoded and the prediction video block.

摘要翻译： 本公开描述了实现这种技术的视频编码技术和视频编码设备。 在一个实施例中，本公开描述了一种视频编码装置，其包括运动估计器，该运动估计器基于先前针对要编码的当前视频块附近的视频块计算的运动矢量来计算运动矢量预测器，并且使用运动矢量预测器来搜索 用于对当前视频块进行编码的预测视频块;以及运动补偿器，其生成指示要编码的当前视频块与预测视频块之间的差异的差分块。

公开(公告)号：US08711926B2

公开(公告)日：2014-04-29

申请号：US11672550

申请日：2007-02-08

申请人： Narendranath Malayath ,  Sharath Manjunath

发明人： Narendranath Malayath ,  Sharath Manjunath

IPC分类号： H04N11/02

CPC分类号： H04N19/154 ,  H04N19/124

摘要： Techniques for estimating distortion due to quantization of data are described. A histogram with multiple bins may be obtained for a set of coefficients to be quantized. Distortion due to quantization of the set of coefficients may be estimated based on the histogram and average distortions for the histogram bins. The number of coefficients in each bin may be multiplied with an average distortion for the bin to obtain a per-bin distortion. The per-bin distortions for all of the bins may be accumulated and scaled with a correction factor to obtain the estimated distortion. The techniques may be used to estimate distortions for a set of coding elements. Distortion and rate may be estimated for each coding element for each of multiple quantization steps. A set of quantization steps may be selected for the set of coding elements based on the estimated distortions and the estimated rates for the set of coding elements for different quantization steps.

摘要翻译： 描述用于估计由数据量化引起的失真的技术。 可以针对要量化的一系列系数获得具有多个箱的直方图。 可以基于直方图库的直方图和平均失真来估计由于系数集合的量化造成的失真。 每个仓中的系数数可以乘以箱的平均失真以获得每桶的失真。 可以用校正因子累积和缩放所有存储体的每个bin的失真，以获得估计的失真。 这些技术可以用于估计一组编码元件的失真。 针对每个多个量化步骤的每个编码元素，可以估计失真和速率。 可以基于估计的失真和用于不同量化步长的编码元件集合的估计速率来为编码元件组选择一组量化步长。

公开(公告)号：US20080192821A1

公开(公告)日：2008-08-14

申请号：US11672550

申请日：2007-02-08

申请人： Narendranath Malayath ,  Sharath Manjunath

发明人： Narendranath Malayath ,  Sharath Manjunath

IPC分类号： H04N7/26

CPC分类号： H04N19/154 ,  H04N19/124

摘要： Techniques for estimating distortion due to quantization of data are described. A histogram with multiple bins may be obtained for a set of coefficients to be quantized. Distortion due to quantization of the set of coefficients may be estimated based on the histogram and average distortions for the histogram bins. The number of coefficients in each bin may be multiplied with an average distortion for the bin to obtain a per-bin distortion. The per-bin distortions for all of the bins may be accumulated and scaled with a correction factor to obtain the estimated distortion. The techniques may be used to estimate distortions for a set of coding elements. Distortion and rate may be estimated for each coding element for each of multiple quantization steps. A set of quantization steps may be selected for the set of coding elements based on the estimated distortions and the estimated rates for the set of coding elements for different quantization steps.

摘要翻译： 描述用于估计由数据量化引起的失真的技术。 可以针对要量化的一系列系数获得具有多个箱的直方图。 可以基于直方图库的直方图和平均失真来估计由于系数集合的量化造成的失真。 每个仓中的系数数可以乘以箱的平均失真以获得每桶的失真。 可以用校正因子累积和缩放所有存储体的每个bin的失真，以获得估计的失真。 这些技术可以用于估计一组编码元件的失真。 针对每个多个量化步骤的每个编码元素，可以估计失真和速率。 可以基于估计的失真和用于不同量化步长的编码元件集合的估计速率来为编码元件组选择一组量化步长。

公开(公告)号：US20080013622A1

公开(公告)日：2008-01-17

申请号：US11776679

申请日：2007-07-12

申请人： Yiliang Bao ,  Narendranath Malayath ,  Sharath Manjunath ,  Yan Ye

发明人： Yiliang Bao ,  Narendranath Malayath ,  Sharath Manjunath ,  Yan Ye

IPC分类号： H04B1/66 ,  G06K9/36 ,  H04N11/02 ,  H04N7/12

CPC分类号： H04N19/34

摘要： The disclosure describes FGS video coding techniques that use cycle-aligned fragments (CAFs). The techniques may perform cycle-based coding of FGS video data block coefficients and syntax elements, and encapsulate cycles in fragments for transmission. The fragments may be cycle-aligned such that a start of a payload of each of the fragments substantially coincides with a start of one of the cycles. In this manner, cycles can be readily accessed via individual fragments. Some cycles may be controlled with a vector mode to scan to a predefined position within a block before moving to another block. In this manner, the number of cycles can be reduced, reducing the number of fragments and associated overhead. The CAFs may be entropy coded independently of one another so that each fragment may be readily accessed and decoded without waiting for decoding of other fragments. Independent entropy coding may permit parallel decoding and simultaneous processing of fragments.

摘要翻译： 本公开描述了使用循环对准片段（CAF）的FGS视频编码技术。 这些技术可以执行FGS视频数据块系数和语法元素的基于循环的编码，并且将循环封装成用于传输的片段。 片段可以是循环对齐的，使得每个片段的有效载荷的开始基本上与循环中的一个的开始重合。 以这种方式，可以容易地通过各个片段访问周期。 可以通过向量模式来控制一些周期，以便在移动到另一个块之前扫描到块内的预定位置。 以这种方式，可以减少周期数，减少片段的数量和相关的开销。 CAF可以彼此独立地进行熵编码，使得每个片段可以容易地被访问和解码，而不等待其他片段的解码。 独立熵编码可以允许并行解码和片段的同时处理。

公开(公告)号：US08948266B2

公开(公告)日：2015-02-03

申请号：US11025297

申请日：2004-12-28

申请人： Yi Liang ,  Khaled Helmi El-Maleh ,  Sharath Manjunath

发明人： Yi Liang ,  Khaled Helmi El-Maleh ,  Sharath Manjunath

IPC分类号： H04N7/12 ,  H04N19/176 ,  H04N19/164 ,  H04N19/89 ,  H04N19/14 ,  H04N19/107 ,  H04N19/172 ,  H04N19/147 ,  H04N19/61

CPC分类号： H04N19/00278 ,  H04N19/107 ,  H04N19/14 ,  H04N19/147 ,  H04N19/164 ,  H04N19/172 ,  H04N19/176 ,  H04N19/61 ,  H04N19/89

摘要： An adaptive Intra-refresh (IR) technique for digital video encoding adjusts IR rate based on video content, or a combination of video content and channel condition. The IR rate may be applied at the frame level or macroblock (MB) level. At the frame level, the IR rate specifies the percentage of MBs to be Intra-coded within the frame. At the MB level, the IR rate defines a statistical probability that a particular MB is to be Intra-coded. The IR rate is adjusted in proportion to a combined metric that weighs estimated channel loss probability, frame-to-frame variation, and texture information. The IR rate can be determined using a close-form solution that requires relatively low implementation complexity. For example, such a close-form does not require iteration or an exhaustive search. In addition, the IR rate can be determined from parameters that are available before motion estimation and compensation are performed.

摘要翻译： 用于数字视频编码的自适应内部刷新（IR）技术基于视频内容或视频内容和频道条件的组合来调整IR速率。 可以在帧级或宏块（MB）级应用IR速率。 在帧级别，IR速率指定帧内帧内编码的百分比。 在MB级别，IR率定义了特定MB被内部编码的统计概率。 IR速率与重量估计的信道丢失概率，帧到帧变化和纹理信息的组合度量成比例地调整。 IR速率可以使用需要较低实现复杂度的紧密形式的解决方案来确定。 例如，这种关闭形式不需要迭代或穷尽搜索。 另外，可以在执行运动估计和补偿之前可用的参数来确定IR速率。

公开(公告)号：US08594180B2

公开(公告)日：2013-11-26

申请号：US11677335

申请日：2007-02-21

申请人： Kai Chieh Yang ,  Haohong Wang ,  Khaled Helmi El-Maleh ,  Sharath Manjunath

发明人： Kai Chieh Yang ,  Haohong Wang ,  Khaled Helmi El-Maleh ,  Sharath Manjunath

IPC分类号： G06F21/00

CPC分类号： H04N19/194 ,  H04N13/122 ,  H04N19/124 ,  H04N19/147 ,  H04N19/149 ,  H04N19/172 ,  H04N19/176 ,  H04N19/597 ,  H04N19/61

摘要： A stereo 3D video frame includes left and right components that are combined to produce a stereo image. For a given amount of distortion, the left and right components may have different impacts on perceptual visual quality of the stereo image due to asymmetry in the distortion response of the human eye. A 3D video encoder adjusts an allocation of coding bits between left and right components of the 3D video based on a frame-level bit budget and a weighting between the left and right components. The video encoder may generate the bit allocation in the rho (ρ) domain. The weighted bit allocation may be derived based on a quality metric that indicates overall quality produced by the left and right components. The weighted bit allocation compensates for the asymmetric distortion response to reduce overall perceptual distortion in the stereo image and thereby enhance or maintain visual quality.

摘要翻译： 立体3D视频帧包括组合以产生立体图像的左和右组件。 对于给定量的失真，由于人眼的失真响应的不对称，左和右分量可能对立体图像的感知视觉质量具有不同的影响。 3D视频编码器基于帧级比特预算和左右分量之间的加权来调整3D视频的左和右分量之间的编码比特的分配。 视频编码器可以在rho（rho）域中生成比特分配。 可以基于指示左组件和右组件产生的总体质量的质量度量来导出加权比特分配。 加权比特分配补偿非对称失真响应，以减少立体图像中的整体感知失真，从而增强或维持视觉质量。

公开(公告)号：US08379734B2

公开(公告)日：2013-02-19

申请号：US11690132

申请日：2007-03-23

申请人： Chia-Yuan Teng ,  Sharath Manjunath

发明人： Chia-Yuan Teng ,  Sharath Manjunath

IPC分类号： H04N7/68

CPC分类号： H04N19/00939 ,  H04N19/107 ,  H04N19/117 ,  H04N19/142 ,  H04N19/159 ,  H04N19/166 ,  H04N19/174 ,  H04N19/895

摘要： Error concealment is used to hide the effects of errors detected within digital video information. A complex error concealment mode decision is disclosed to determine whether spatial error concealment (SEC) or temporal error concealment (TEC) should be used. The error concealment mode decision system uses different methods depending on whether the damaged frame is an intra-frame or an inter-frame. If the video frame is an intra-frame then a similarity metric is used to determine if the intra-frame represents a scene-change or not. If the video frame is an intra-frame, a complex multi-termed equation is used to determine whether SEC or TEC should be used. A novel spatial error concealment technique is disclosed for use when the error concealment mode decision determines that spatial error concealment should be used for reconstruction. The novel spatial error concealment technique divides a corrupt macroblock into four different regions, a corner region, a row adjacent to the corner region, a column adjacent to the corner region, and a remainder main region. Those regions are then reconstructed in that order and information from earlier reconstructed regions may be used in later reconstructed regions. Finally, a macroblock refreshment technique is disclosed for preventing error propagation from harming non-corrupt inter-blocks. Specifically, an inter-macroblock may be ‘refreshed’ using spatial error concealment if there has been significant error caused damage that may cause the inter-block to propagate the errors.

摘要翻译： 错误隐藏用于隐藏数字视频信息中检测到的错误的影响。 公开了一种复杂的错误隐藏模式决定，以确定是否应使用空间误差隐藏（SEC）或时间误差隐藏（TEC）。 错误隐藏模式决策系统使用不同的方法，取决于损坏的帧是帧内还是帧间。 如果视频帧是帧内帧，则使用相似性度量来确定帧内是否表示场景改变。 如果视频帧是帧内帧，则使用复数多方程来确定是否应使用SEC或TEC。 当错误隐藏模式决定确定空间误差隐藏应用于重建时，公开了一种新颖的空间误差隐藏技术。 新颖的空间误差隐藏技术将腐败的宏块分为四个不同的区域，一个角区域，一个与拐角区域相邻的一行，一个邻近拐角区域的列以及一个剩余的主区域。 然后按照该顺序重建那些区域，并且可以在稍后的重建区域中使用来自较早重建区域的信息。 最后，公开了一种宏块刷新技术，用于防止错误传播损害非损坏的块间。 具体地，如果存在可能导致块间传播错误的严重错误引起的损坏，则可以使用空间错误隐藏来刷新宏块间宏块。

公开(公告)号：US08145477B2

公开(公告)日：2012-03-27

申请号：US11566039

申请日：2006-12-01

申请人： Sharath Manjunath ,  Ananthapadmanabhan A. Kandhadai

发明人： Sharath Manjunath ,  Ananthapadmanabhan A. Kandhadai

IPC分类号： G10L11/00 ,  G06F17/15

CPC分类号： G10L19/097

摘要： Systems, methods, and apparatus described include waveform alignment operations in which a single set of evaluated cosines and sines is used to calculate cross-correlations of two periodic waveforms at two different phase shifts.

摘要翻译： 所描述的系统，方法和装置包括波形对准操作，其中使用单组估计的余弦和正弦来计算两个不同相移处的两个周期波形的互相关。

公开(公告)号：US08090577B2

公开(公告)日：2012-01-03

申请号：US10215533

申请日：2002-08-08

申请人： Khaled Helmi El-Maleh ,  Ananthapadmanabhan Arasanipalai Kandhadai ,  Sharath Manjunath

发明人： Khaled Helmi El-Maleh ,  Ananthapadmanabhan Arasanipalai Kandhadai ,  Sharath Manjunath

IPC分类号： G10L19/00

CPC分类号： G10L19/002 ,  G10L19/0208 ,  G10L19/12 ,  G10L2019/0005

摘要： Methods and apparatus are presented for determining the type of acoustic signal and the type of frequency spectrum exhibited by the acoustic signal in order to selectively delete parameter information before vector quantization. The bits that would otherwise be allocated to the deleted parameters can then be re-allocated to the quantization of the remaining parameters, which results in an improvement of the perceptual quality of the synthesized acoustic signal. Alternatively, the bits that would have been allocated to the deleted parameters are dropped, resulting in an overall bit-rate reduction.

摘要翻译： 提出了用于确定声信号的类型和声信号显示的频谱的类型的方法和装置，以便在矢量量化之前选择性地删除参数信息。 否则将分配给删除的参数的位可以被重新分配给剩余参数的量化，这导致合成声信号的感知质量的改善。 或者，将分配给删除的参数的位将被丢弃，导致整体比特率降低。