Motion-compensated prediction of inter-layer residuals
    1.
    发明授权
    Motion-compensated prediction of inter-layer residuals 有权
    层间残差运动补偿预测

    公开(公告)号:US08711948B2

    公开(公告)日:2014-04-29

    申请号:US12077768

    申请日:2008-03-21

    IPC分类号: H04N7/12

    摘要: Techniques and tools are described for scalable video encoding and decoding. In some embodiments, an encoding tool encodes base layer video and outputs encoded base layer video in a base layer bit stream. The encoding tool encodes inter-layer residual video (representing differences between input video and reconstructed base layer video) using motion compensation relative to previously reconstructed inter-layer residual video. For the inter-layer residual video, the encoding tool outputs motion information and motion-compensated prediction residuals in an enhancement layer bit stream. A decoding tool receives the base layer bit stream and enhancement layer bit stream, reconstructs base layer video, reconstructs inter-layer residual video, and combines the reconstructed base layer video and reconstructed inter-layer residual video. Using motion compensation for the inter-layer residual video facilitates the use of separate motion vectors and separate codecs for the base layer video and inter-layer residual video.

    摘要翻译: 描述了可扩展视频编码和解码的技术和工具。 在一些实施例中,编码工具对基层视频进行编码并在基层比特流中输出经编码的基层视频。 编码工具使用相对于先前重建的层间残留视频的运动补偿来编码层间残差视频(表示输入视频和重建的基本层视频之间的差异)。 对于层间残差视频,编码工具在增强层比特流中输出运动信息和运动补偿预测残差。 解码工具接收基层比特流和增强层比特流,重构基层视频,重建层间残留视频,并组合重建的基层视频和重建层间残留视频。 对于层间残留视频使用运动补偿有助于使用单独的运动矢量和单独的编解码器用于基本层视频和层间残留视频。

    Reducing DC leakage in HD photo transform
    2.
    发明授权
    Reducing DC leakage in HD photo transform 有权
    降低高清摄影中的直流泄漏

    公开(公告)号:US08369638B2

    公开(公告)日:2013-02-05

    申请号:US12165474

    申请日:2008-06-30

    IPC分类号: G06K9/36

    摘要: In certain embodiments, to eliminate DC leakage into surrounding AC values, scaling stage within a photo overlap transform operator is modified such that the off-diagonal elements of the associated scaling matrix have the values of 0. In certain embodiments, the on-diagonal scaling matrix are given the values (0.5, 2). In some embodiments, the scaling is performed using a combination of reversible modulo arithmetic and lifting steps. In yet other embodiments, amount of DC leakage is estimated at the encoder, and preprocessing occurs to mitigate amount of leakage, with the bitstream signaling that preprocessing has occurred. A decoder may then read the signal and use the information to mitigate DC leakage.

    摘要翻译: 在某些实施例中,为了将DC泄漏消除到周围的AC值中,修改照片重叠变换算子内的缩放阶段,使得相关联的缩放矩阵的非对角元素具有值0.在某些实施例中, 矩阵给出值(0.5,2)。 在一些实施例中,使用可逆模运算和提升步骤的组合来执行缩放。 在其他实施例中,在编码器处估计DC泄漏量,并且发生预处理以减轻泄漏量,同时比特流指示已经发生预处理。 然后,解码器可以读取信号并使用该信息来减轻DC泄漏。

    REDUCING DC LEAKAGE IN HD PHOTO TRANSFORM
    3.
    发明申请
    REDUCING DC LEAKAGE IN HD PHOTO TRANSFORM 有权
    降低HD照相变换中的直流泄漏

    公开(公告)号:US20090297054A1

    公开(公告)日:2009-12-03

    申请号:US12165474

    申请日:2008-06-30

    IPC分类号: G06K9/36

    摘要: In certain embodiments, to eliminate DC leakage into surrounding AC values, scaling stage within a photo overlap transform operator is modified such that the off-diagonal elements of the associated scaling matrix have the values of 0. In certain embodiments, the on-diagonal scaling matrix are given the values (0.5, 2). In some embodiments, the scaling is performed using a combination of reversible modulo arithmetic and lifting steps. In yet other embodiments, amount of DC leakage is estimated at the encoder, and preprocessing occurs to mitigate amount of leakage, with the bitstream signaling that preprocessing has occurred. A decoder may then read the signal and use the information to mitigate DC leakage.

    摘要翻译: 在某些实施例中,为了将DC泄漏消除到周围的AC值中,修改照片重叠变换算子内的缩放阶段,使得相关联的缩放矩阵的非对角元素具有值0.在某些实施例中, 矩阵给出值(0.5,2)。 在一些实施例中,使用可逆模运算和提升步骤的组合来执行缩放。 在其他实施例中,在编码器处估计DC泄漏量,并且发生预处理以减轻泄漏量,同时比特流指示已经发生预处理。 然后,解码器可以读取信号并使用该信息来减轻DC泄漏。

    Motion-compensated prediction of inter-layer residuals
    5.
    发明申请
    Motion-compensated prediction of inter-layer residuals 有权
    层间残差运动补偿预测

    公开(公告)号:US20090238279A1

    公开(公告)日:2009-09-24

    申请号:US12077768

    申请日:2008-03-21

    IPC分类号: H04N7/34 H04N7/26

    摘要: Techniques and tools are described for scalable video encoding and decoding. In some embodiments, an encoding tool encodes base layer video and outputs encoded base layer video in a base layer bit stream. The encoding tool encodes inter-layer residual video (representing differences between input video and reconstructed base layer video) using motion compensation relative to previously reconstructed inter-layer residual video. For the inter-layer residual video, the encoding tool outputs motion information and motion-compensated prediction residuals in an enhancement layer bit stream. A decoding tool receives the base layer bit stream and enhancement layer bit stream, reconstructs base layer video, reconstructs inter-layer residual video, and combines the reconstructed base layer video and reconstructed inter-layer residual video. Using motion compensation for the inter-layer residual video facilitates the use of separate motion vectors and separate codecs for the base layer video and inter-layer residual video.

    摘要翻译: 描述了可扩展视频编码和解码的技术和工具。 在一些实施例中,编码工具对基层视频进行编码并在基层比特流中输出经编码的基层视频。 编码工具使用相对于先前重建的层间残留视频的运动补偿来编码层间残差视频(表示输入视频和重建的基本层视频之间的差异)。 对于层间残差视频,编码工具在增强层比特流中输出运动信息和运动补偿预测残差。 解码工具接收基层比特流和增强层比特流,重构基层视频,重建层间残留视频,并组合重建的基层视频和重建层间残留视频。 对于层间残留视频使用运动补偿有助于使用单独的运动矢量和单独的编解码器用于基本层视频和层间残留视频。

    Scalable video coding and decoding with sample bit depth and chroma high-pass residual layers
    6.
    发明申请
    Scalable video coding and decoding with sample bit depth and chroma high-pass residual layers 有权
    具有采样位深度和色度高通残余层的可扩展视频编码和解码

    公开(公告)号:US20090219994A1

    公开(公告)日:2009-09-03

    申请号:US12074030

    申请日:2008-02-29

    IPC分类号: H04N7/26

    摘要: Techniques and tools are described for scalable video encoding and decoding. In some embodiments, an input frame is downsampled in terms of sample depth and chroma sampling rate, encoded, and output from the encoder as a base layer bitstream. The base layer bitstream is also reconstructed and upsampled to produce a reconstructed bitstream which is subtracted from the original input frame to produce a residual layer. The residual layer is split and encoded as a sample depth residual layer bitstream and a chroma high-pass residual layer bitstream. To recover the encoded input frame, a decoder receives one or more of these bitstreams, decodes them, and combines them to form a reconstructed image. The use of separate codecs is allowed for the base layer and the enhancement layers, without inter-layer dependencies.

    摘要翻译: 描述了可扩展视频编码和解码的技术和工具。 在一些实施例中,输入帧根据样本深度和色度采样率进行下采样,编码并从编码器输出作为基本层比特流。 基层比特流也被重建并上采样以产生从原始输入帧中减去的重构比特流,以产生残余层。 残余层被分割并编码为采样深度残留层比特流和色度高通残留层比特流。 为了恢复编码的输入帧,解码器接收这些比特流中的一个或多个,对它们进行解码,并将它们组合以形成重构的图像。 对于基本层和增强层,允许使用单独的编解码器,而不需要层间依赖。

    Conversion operations in scalable video encoding and decoding
    7.
    发明授权
    Conversion operations in scalable video encoding and decoding 有权
    可扩展视频编码和解码中的转换操作

    公开(公告)号:US09571856B2

    公开(公告)日:2017-02-14

    申请号:US12197922

    申请日:2008-08-25

    摘要: Techniques and tools for conversion operations between modules in a scalable video encoding tool or scalable video decoding tool are described. For example, given reconstructed base layer video in a low resolution format (e.g., 4:2:0 video with 8 bits per sample) an encoding tool and decoding tool adaptively filter the reconstructed base layer video and upsample its sample values to a higher sample depth (e.g., 10 bits per sample). The tools also adaptively scale chroma samples to a higher chroma sampling rate (e.g., 4:2:2). The adaptive filtering and chroma scaling help reduce energy in inter-layer residual video by making the reconstructed base layer video closer to input video, which typically makes compression of the inter-layer residual video more efficient. The encoding tool also remaps sample values of the inter-layer residual video to adjust dynamic range before encoding, and the decoding tool performs inverse remapping after decoding.

    摘要翻译: 描述了可扩展视频编码工具或可扩展视频解码工具中的模块之间的转换操作的技术和工具。 例如,给定以低分辨率格式的重建基层视频(例如,具有每个样本8位的4:2:0视频),编码工具和解码工具自适应地过滤重建的基层视频并将其样本值上采样到较高的样本 深度(例如每个样本10位)。 这些工具还可以自适应地将色度样本缩放到更高的色度采样率(例如4:2:2)。 自适应滤波和色度缩放有助于通过使重构的基本层视频更接近输入视频来减少层间残留视频中的能量,这通常使得层间残留视频的压缩更有效。 编码工具还重新映射层间残差视频的采样值,以便在编码之前调整动态范围,并且解码工具在解码之后执行反向重新映射。

    CONVERSION OPERATIONS IN SCALABLE VIDEO ENCODING AND DECODING
    8.
    发明申请
    CONVERSION OPERATIONS IN SCALABLE VIDEO ENCODING AND DECODING 有权
    可扩展视频编码和解码中的转换操作

    公开(公告)号:US20100046612A1

    公开(公告)日:2010-02-25

    申请号:US12197922

    申请日:2008-08-25

    IPC分类号: H04N7/26

    摘要: Techniques and tools for conversion operations between modules in a scalable video encoding tool or scalable video decoding tool are described. For example, given reconstructed base layer video in a low resolution format (e.g., 4:2:0 video with 8 bits per sample) an encoding tool and decoding tool adaptively filter the reconstructed base layer video and upsample its sample values to a higher sample depth (e.g., 10 bits per sample). The tools also adaptively scale chroma samples to a higher chroma sampling rate (e.g., 4:2:2). The adaptive filtering and chroma scaling help reduce energy in inter-layer residual video by making the reconstructed base layer video closer to input video, which typically makes compression of the inter-layer residual video more efficient. The encoding tool also remaps sample values of the inter-layer residual video to adjust dynamic range before encoding, and the decoding tool performs inverse remapping after decoding.

    摘要翻译: 描述了可扩展视频编码工具或可扩展视频解码工具中的模块之间的转换操作的技术和工具。 例如,给定以低分辨率格式的重建基层视频(例如,具有每个样本8位的4:2:0视频),编码工具和解码工具自适应地过滤重建的基层视频并将其样本值上采样到较高的样本 深度(例如每个样本10位)。 这些工具还可以自适应地将色度样本缩放到更高的色度采样率(例如4:2:2)。 自适应滤波和色度缩放有助于通过使重构的基本层视频更接近输入视频来减少层间残留视频中的能量,这通常使得层间残留视频的压缩更有效。 编码工具还重新映射层间残差视频的采样值,以便在编码之前调整动态范围,并且解码工具在解码之后执行反向重新映射。

    MULTI-LEVEL REPRESENTATION OF REORDERED TRANSFORM COEFFICIENTS
    9.
    发明申请
    MULTI-LEVEL REPRESENTATION OF REORDERED TRANSFORM COEFFICIENTS 有权
    多级变换系数的多级表示

    公开(公告)号:US20120243615A1

    公开(公告)日:2012-09-27

    申请号:US13458774

    申请日:2012-04-27

    IPC分类号: H04N7/26

    摘要: Techniques and tools for encoding and decoding a block of frequency coefficients are presented. An encoder selects a scan order from multiple available scan orders and then applies the selected scan order to a two-dimensional matrix of transform coefficients, grouping non-zero values of the frequency coefficients together in a one-dimensional string. The encoder entropy encodes the one-dimensional string of coefficient values according to a multi-level nested set representation. In decoding, a decoder entropy decodes the one-dimensional string of coefficient values from the multi-level nested set representation. The decoder selects the scan order from among multiple available scan orders and then reorders the coefficients back into a two-dimensional matrix using the selected scan order.

    摘要翻译: 提出了用于编码和解码频率系数块的技术和工具。 编码器从多个可用扫描顺序中选择扫描顺序,然后将所选择的扫描顺序应用于变换系数的二维矩阵,将频率系数的非零值在一维串中分组。 编码器根据多级嵌套集合表示对一维系列值串进行编码。 在解码中,解码器熵从多级嵌套集合表示解码系数值的一维串。 解码器从多个可用扫描顺序中选择扫描顺序,然后使用所选择的扫描顺序将系数重新排序成二维矩阵。

    Skip modes for inter-layer residual video coding and decoding
    10.
    发明授权
    Skip modes for inter-layer residual video coding and decoding 有权
    跳过模式进行层间残留视频编码和解码

    公开(公告)号:US08213503B2

    公开(公告)日:2012-07-03

    申请号:US12205689

    申请日:2008-09-05

    IPC分类号: H04N7/12

    摘要: Techniques and tools for skip modes in encoding and decoding of inter-layer residual video are described. For example, an encoder encodes multiple macroblocks of a picture of inter-layer residual video. For a current macroblock that is skipped, the encoder selects a skip mode from among multiple available skip modes and uses the selected skip mode when encoding the current macroblock. The skip modes can include intra skip mode and predicted-motion skip mode. A corresponding decoder, for the current macroblock, selects and uses the skip mode for the current macroblock during decoding. As another example, an encoder encodes multiple channels of a picture of inter-layer residual video. For each channel, the encoder determines whether to skip the channel. The encoder signals channel skip information to indicate which channels are skipped. A corresponding decoder parses the channel skip information and determines on a channel-by-channel basis whether to skip the respective channels.

    摘要翻译: 描述了层间残差视频编码和解码中跳过模式的技术和工具。 例如,编码器编码层间残留视频的图像的多个宏块。 对于跳过的当前宏块,编码器从多个可用跳过模式中选择跳过模式,并且在对当前宏块进行编码时使用所选择的跳过模式。 跳过模式可以包括帧内跳过模式和预测运动跳过模式。 对于当前宏块,对应的解码器在解码期间选择并使用当前宏块的跳过模式。 作为另一示例,编码器对层间残留视频的图像的多个信道进行编码。 对于每个通道,编码器确定是否跳过通道。 编码器信号通道跳过信息以指示哪些通道被跳过。 相应的解码器解析信道跳过信息,并且逐个信道地确定是否跳过相应的信道。