Architecture and method for fine granularity scalable video coding
    1.
    发明授权
    Architecture and method for fine granularity scalable video coding 有权
    精细粒度可扩展视频编码的架构和方法

    公开(公告)号:US07072394B2

    公开(公告)日:2006-07-04

    申请号:US10229580

    申请日:2002-08-27

    IPC分类号: H04B1/66

    CPC分类号: H04N19/34 H04N19/33

    摘要: A robust fine granularity scalability video encoding includes a base layer encoder and an enhancement layer encoder in which motion compensated difference images are generated by comparing an original image to predicted images at base layer and enhancement layer with motion compensation. Based on leaky and partial predictions, a high quality reference image is constructed at the enhancement layer to improve temporal prediction. In the construction of the high quality reference image, one parameter β controls the number of bitplanes of the enhancement layer difference coefficients used and another parameter α controls the amount of predictive leak. A spatial scalability module allows the processed pictures at the base layer and the enhancement layer to have identical or different spatial resolutions.

    摘要翻译: 强大的细粒度可伸缩性视频编码包括基本层编码器和增强层编码器,其中通过将原始图像与基本层和具有运动补偿的增强层的预测图像进行比较来生成运动补偿差分图像。 基于泄漏和部分预测,在增强层构建高质量参考图像以改善时间预测。 在构建高质量参考图像时,一个参数β控制所使用的增强层差分系数的位平面数,另一参数α控制预测泄漏量。 空间可扩展性模块允许基础层和增强层处理的图像具有相同或不同的空间分辨率。

    Architecture and method for fine granularity scalable video coding
    2.
    发明申请
    Architecture and method for fine granularity scalable video coding 有权
    精细粒度可扩展视频编码的架构和方法

    公开(公告)号:US20050220192A1

    公开(公告)日:2005-10-06

    申请号:US11136780

    申请日:2005-05-25

    IPC分类号: H04N7/12 H04N7/26 H04N7/32

    CPC分类号: H04N19/34 H04N19/33

    摘要: A robust fine granularity scalability video encoding includes a base layer encoder and an enhancement layer encoder in which motion compensated difference images are generated by comparing an original image to predicted images at base layer and enhancement layer with motion compensation. Based on leaky and partial predictions, a high quality reference image is constructed at the enhancement layer to improve temporal prediction. In the construction of the high quality reference image, one parameter β controls the number of bitplanes of the enhancement layer difference coefficients used and another parameter α controls the amount of predictive leak. A spatial scalability module allows the processed pictures at the base layer and the enhancement layer to have identical or different spatial resolutions.

    摘要翻译: 强大的细粒度可伸缩性视频编码包括基本层编码器和增强层编码器,其中通过将原始图像与基本层和具有运动补偿的增强层的预测图像进行比较来生成运动补偿差分图像。 基于泄漏和部分预测,在增强层构建高质量参考图像以改善时间预测。 在构建高质量参考图像时,一个参数β控制所使用的增强层差分系数的位平面数,另一参数α控制预测泄漏量。 空间可扩展性模块允许基础层和增强层处理的图像具有相同或不同的空间分辨率。

    Architecture and method for fine granularity scalable video coding
    3.
    发明授权
    Architecture and method for fine granularity scalable video coding 有权
    精细粒度可扩展视频编码的架构和方法

    公开(公告)号:US07203235B2

    公开(公告)日:2007-04-10

    申请号:US11136780

    申请日:2005-05-25

    IPC分类号: H04B1/66

    CPC分类号: H04N19/34 H04N19/33

    摘要: A robust fine granularity scalability video encoding includes a base layer encoder and an enhancement layer encoder in which motion compensated difference images are generated by comparing an original image to predicted images at base layer and enhancement layer with motion compensation. Based on leaky and partial predictions, a high quality reference image is constructed at the enhancement layer to improve temporal prediction. In the construction of the high quality reference image, one parameter β controls the number of bitplanes of the enhancement layer difference coefficients used and another parameter α controls the amount of predictive leak. A spatial scalability module allows the processed pictures at the base layer and the enhancement layer to have identical or different spatial resolutions.

    摘要翻译: 强大的细粒度可伸缩性视频编码包括基本层编码器和增强层编码器,其中通过将原始图像与基本层和具有运动补偿的增强层的预测图像进行比较来生成运动补偿差分图像。 基于泄漏和部分预测,在增强层构建高质量参考图像以改善时间预测。 在构建高质量参考图像时,一个参数β控制所使用的增强层差分系数的位平面数,另一参数α控制预测泄漏量。 空间可扩展性模块允许基础层和增强层处理的图像具有相同或不同的空间分辨率。

    Architecture for stack robust fine granularity scalability
    4.
    发明申请
    Architecture for stack robust fine granularity scalability 审中-公开
    堆栈的架构稳健的细粒度可扩展性

    公开(公告)号:US20050195896A1

    公开(公告)日:2005-09-08

    申请号:US10793830

    申请日:2004-03-08

    IPC分类号: H04N7/12

    CPC分类号: H04N19/36 H04N19/34 H04N19/61

    摘要: The present invention relates to an architecture for stack robust fine granularity scalability (SRFGS), more particularly, SRFGS providing simultaneously temporal scalability and SNR scalability. SRFGS first simplifies the RFGS temporal prediction architecture and then generalizes the prediction concept as the following: the quantization error of the previous layer can be inter-predicted by the reconstructed image in the previous time instance of the same layer. With this concept, the RFGS architecture can be extended to multiple layers that forming a stack to improve the temporal prediction efficiency. SRFGS can be optimized at several operating points to fit the requirements of various applications while the fine granularity and error robustness of RFGS are still remained. The experiment results show that SRFGS can improve the performance of RFGS by 0.4 to 3.0 dB in PSNR.

    摘要翻译: 本发明涉及用于堆栈鲁棒的精细粒度可伸缩性(SRFGS)的架构,更具体地说,涉及提供同时时间可扩展性和SNR可伸缩性的SRFGS。 SRFGS首先简化RFGS时间预测架构,然后将预测概​​念概括如下:先前层的量化误差可以由同一层的先前时间实例中的重建图像进行预测。 利用这个概念,RFGS架构可以扩展到形成堆栈的多个层,以提高时间预测效率。 SRFGS可以在几个操作点进行优化,以适应各种应用的要求,同时仍保持RFGS的细粒度和误差鲁棒性。 实验结果表明,SRFGS可以在PSNR中将RFGS的性能提高0.4〜3.0dB。

    Method and apparatus for motion estimation with all binary representation
    5.
    发明授权
    Method and apparatus for motion estimation with all binary representation 失效
    具有所有二进制表示的运动估计的方法和装置

    公开(公告)号:US07020201B2

    公开(公告)日:2006-03-28

    申请号:US10301415

    申请日:2002-11-20

    IPC分类号: H04B1/66 H04N7/12

    CPC分类号: H04N5/145 H04N19/53

    摘要: A method of motion estimation for video encoding constructs a binary pyramid structure having three binary layers. A state update module registers and updates repeat occurrence of final motion vectors and a static-state checking module determines if the method is in a static mode or a normal mode based on the repeat occurrence. In a normal mode, the first binary layer is searched within a ±3 pixel refinement window to determine a first level motion vector. In the second binary layer, a search range is computed based on six motion vector candidates. By checking every point within in the search range, a second binary layer search generates a second level motion vector. Finally, a third binary layer search within a ±2 pixel refinement window generates a final motion vector according to the second level motion vector. In a static mode, a fine tuning module performs search within a ±1 pixel refinement window and generates a final motion vector.

    摘要翻译: 视频编码的运动估计方法构成具有三个二进制层的二进制金字塔结构。 状态更新模块注册和更新最终运动矢量的重复发生,并且静态状态检查模块基于重复发生来确定该方法是处于静态模式还是正常模式。 在正常模式中,在±3像素细化窗口内搜索第一二进制层以确定第一级运动矢量。 在第二二进制层中,基于六个运动矢量候选来计算搜索范围。 通过检查搜索范围内的每个点,第二二进制层搜索生成第二级运动矢量。 最后,±2像素细化窗口内的第三二进制层搜索根据第二级运动矢量生成最终运动矢量。 在静态模式中,微调模块在±1像素细化窗口内进行搜索,并生成最终的运动矢量。

    MPEG-4 streaming system with adaptive error concealment
    6.
    发明申请
    MPEG-4 streaming system with adaptive error concealment 有权
    具有自适应错误隐藏的MPEG-4流媒体系统

    公开(公告)号:US20060104366A1

    公开(公告)日:2006-05-18

    申请号:US10990818

    申请日:2004-11-16

    摘要: An MPEG-4 system with error concealment is provided for video service under the network with packet loss. The MPEG-4 system includes an encoder and a decoder. The encoder uses an intra-refreshment technique is used to make coded bitstream more robust against noise in order to stop error propagation. The rate-distortion optimization criterion is also introduced to adaptively update in synchronization with intra-coded blocks adaptively based on the true network condition with minimal overhead. The Lagrange multiplier is modified to achieve the best rate-distortion balance. In addition, a decoder loop is used in the encoder and is synchronized with the true decoder to achieve the best performance and avoid mismatch with the decoder used in the MPEG-4 system. The decoder is able to achieve resilient decoding from any kind of noise and enhance the reconstructed image quality with spatial and temporal hybrid concealment method. The result shows that a 3.65-9.71 dB further improvement on peak-signal-to-noise-ratio (PSNR) can be achieved in comparison with the existing methods that adopt spatial copy and zero motion concealment in decoding.

    摘要翻译: 为具有丢包的网络下的视频服务提供了具有错误隐藏的MPEG-4系统。 MPEG-4系统包括编码器和解码器。 编码器使用内部刷新技术来使编码比特流更加鲁棒地抵抗噪声,以便停止错误传播。 还引入了速率失真优化标准,以最小的开销,基于真实的网络条件自适应地自适应地更新与帧内编码块的内部编码块。 修改拉格朗日乘数以获得最佳的速率 - 失真平衡。 另外,在编码器中使用解码器环路,并且与真实解码器同步以实现最佳性能并避免与MPEG-4系统中使用的解码器不匹配。 解码器能够通过任何种类的噪声实现弹性解码,并通过空间和时间混合隐藏方法增强重建的图像质量。 结果表明,与采用空间复制和零运动隐藏解码的现有方法相比,可以实现峰值信噪比(PSNR)的3.65-9.71dB进一步改善。

    MPEG-4 streaming system with adaptive error concealment
    7.
    发明授权
    MPEG-4 streaming system with adaptive error concealment 有权
    具有自适应错误隐藏的MPEG-4流媒体系统

    公开(公告)号:US07738561B2

    公开(公告)日:2010-06-15

    申请号:US10990818

    申请日:2004-11-16

    IPC分类号: H04N7/12

    摘要: An MPEG-4 system with error concealment is provided for video service under the network with packet loss. The MPEG-4 system includes an encoder and a decoder. The encoder uses an intra-refreshment technique is used to make coded bitstream more robust against noise in order to stop error propagation. The rate-distortion optimization criterion is also introduced to adaptively update in synchronization with intra-coded blocks adaptively based on the true network condition with minimal overhead. The Lagrange multiplier is modified to achieve the best rate-distortion balance. In addition, a decoder loop is used in the encoder and is synchronized with the true decoder to achieve the best performance and avoid mismatch with the decoder used in the MPEG-4 system. The decoder is able to achieve resilient decoding from any kind of noise and enhance the reconstructed image quality with spatial and temporal hybrid concealment method. The result shows that a 3.65-9.71 dB further improvement on peak-signal-to-noise-ratio (PSNR) can be achieved in comparison with the existing methods that adopt spatial copy and zero motion concealment in decoding.

    摘要翻译: 为具有丢包的网络下的视频服务提供了具有错误隐藏的MPEG-4系统。 MPEG-4系统包括编码器和解码器。 编码器使用内部刷新技术来使编码比特流更加鲁棒地抵抗噪声,以便阻止错误传播。 还引入了速率失真优化标准,以最小的开销,基于真实的网络条件自适应地自适应地更新与帧内编码块的内部编码块。 修改拉格朗日乘数以获得最佳的速率 - 失真平衡。 另外,在编码器中使用解码器环路,并且与真实解码器同步以实现最佳性能并避免与MPEG-4系统中使用的解码器不匹配。 解码器能够通过任何种类的噪声实现弹性解码,并通过空间和时间混合隐藏方法增强重建的图像质量。 结果表明,与采用空间复制和零运动隐藏解码的现有方法相比,可以实现峰值信噪比(PSNR)的3.65-9.71dB进一步改善。

    MPEG-4 Streaming System With Adaptive Error Concealment

    公开(公告)号:US20090086828A1

    公开(公告)日:2009-04-02

    申请号:US12326105

    申请日:2008-12-02

    IPC分类号: H04N7/26

    摘要: An MPEG-4 system with error concealment is provided for video service under the network with packet loss. The MPEG-4 system includes an encoder and a decoder. The encoder uses an intra-refreshment technique is used to make coded bitstream more robust against noise in order to stop error propagation. The rate-distortion optimization criterion is also introduced to adaptively update in synchronization with intra-coded blocks adaptively based on the true network condition with minimal overhead. The Lagrange multiplier is modified to achieve the best rate-distortion balance. In addition, a decoder loop is used in the encoder and is synchronized with the true decoder to achieve the best performance and avoid mismatch with the decoder used in the MPEG-4 system. The decoder is able to achieve resilient decoding from any kind of noise and enhance the reconstructed image quality with spatial and temporal hybrid concealment method. The result shows that a 3.65-9.71 dB further improvement on peak-signal-to-noise-ratio (PSNR) can be achieved in comparison with the existing methods that adopt spatial copy and zero motion concealment in decoding.

    MPEG-4 Streaming System With Adaptive Error Concealment
    9.
    发明申请
    MPEG-4 Streaming System With Adaptive Error Concealment 审中-公开
    具有自适应误差隐藏的MPEG-4流系统

    公开(公告)号:US20090086819A1

    公开(公告)日:2009-04-02

    申请号:US12326104

    申请日:2008-12-02

    IPC分类号: H04N7/32

    摘要: An MPEG-4 system with error concealment is provided for video service under the network with packet loss. The MPEG-4 system includes an encoder and a decoder. The encoder uses an intra-refreshment technique is used to make coded bitstream more robust against noise in order to stop error propagation. The rate-distortion optimization criterion is also introduced to adaptively update in synchronization with intra-coded blocks adaptively based on the true network condition with minimal overhead. The Lagrange multiplier is modified to achieve the best rate-distortion balance. In addition, a decoder loop is used in the encoder and is synchronized with the true decoder to achieve the best performance and avoid mismatch with the decoder used in the MPEG-4 system. The decoder is able to achieve resilient decoding from any kind of noise and enhance the reconstructed image quality with spatial and temporal hybrid concealment method. The result shows that a 3.65-9.71 dB further improvement on peak-signal-to-noise-ratio (PSNR) can be achieved in comparison with the existing methods that adopt spatial copy and zero motion concealment in decoding.

    摘要翻译: 为具有丢包的网络下的视频服务提供了具有错误隐藏的MPEG-4系统。 MPEG-4系统包括编码器和解码器。 编码器使用内部刷新技术来使编码比特流更加鲁棒地抵抗噪声,以便阻止错误传播。 还引入了速率失真优化标准,以最小的开销,基于真实的网络条件自适应地自适应地更新与帧内编码块的内部编码块。 修改拉格朗日乘数以获得最佳的速率 - 失真平衡。 另外,在编码器中使用解码器环路,并且与真实解码器同步以实现最佳性能并避免与MPEG-4系统中使用的解码器不匹配。 解码器能够通过任何种类的噪声实现弹性解码,并通过空间和时间混合隐藏方法增强重建的图像质量。 结果表明,与采用空间复制和零运动隐藏解码的现有方法相比,可以实现峰值信噪比(PSNR)的3.65-9.71dB进一步改善。

    Fast motion estimation using N-queen pixel decimation

    公开(公告)号:US07027511B2

    公开(公告)日:2006-04-11

    申请号:US10118370

    申请日:2002-04-09

    IPC分类号: H04B1/66

    CPC分类号: H04N5/145 H04N19/53

    摘要: The present invention proposes a fast motion estimation using N-queen pixel decimation, whereby after a reference block and a block to be processed are selected in a video sequence, an N×N queens pattern is used for pixel decimation to perform block match, thereby obtaining a good enough block difference value. The present invention combines pixel decimation with fast motion estimation for search points reduction to achieve the object of simplifying computational complexity of motion estimation. Therefore, the present invention can sieve out sufficiently representative pixels and will not increase extra computational complexity.