公开(公告)号：US20170078672A1

公开(公告)日：2017-03-16

申请号：US14853215

申请日：2015-09-14

Applicant: Google Inc.

Inventor： Jingning Han ,  Yaowu Xu ,  Cheng Chen

IPC: H04N19/159 ,  H04N19/61 ,  H04N19/124 ,  H04N19/625 ,  H04N19/91 ,  H04N19/593 ,  H04N19/176 ,  H04N19/89

CPC classification number: H04N19/159 ,  H04N19/112 ,  H04N19/124 ,  H04N19/147 ,  H04N19/176 ,  H04N19/593 ,  H04N19/60 ,  H04N19/61 ,  H04N19/625 ,  H04N19/89 ,  H04N19/91

Abstract: Blocks of a frame of a non-baseband video signal are encoded by selecting between a staircase- or sinusoidal-based transform. For each prediction mode, a prediction block for encoding a current block is generated, a residual block is generated, the residual block is transformed using a sinusoidal-based transform and using a staircase-based transform, and first and second rate-distortion value for encoding the residual block using the sinusoidal-based transform and staircase-based transform are respectively generated. One of the staircase-based transform or the sinusoidal-based transform for encoding the residual block is selected based on a lowest value of the first rate-distortion value and the second rate-distortion value among results for each prediction mode, and the current block is encoded using the selected one of the staircase-based transform or the sinusoidal-based transform. Improved appearance for blocks having sharp edges can be achieved and lossless encoding is possible using the staircase-based transform.

Abstract translation: 通过在基于阶梯或正弦曲线的变换之间进行选择来编码非基带视频信号的帧的块。 对于每个预测模式，生成用于对当前块进行编码的预测块，生成残余块，使用基于正弦曲线的变换并使用基于阶梯的变换来变换残差块，并且使用第一和第二速率失真值 分别使用基于正弦的变换和基于阶梯的变换对残差块进行编码。 基于用于编码残差块的基于阶梯变换或基于正弦曲线的变换之一是基于每个预测模式的结果中的第一速率失真值和第二速率失真值的最低值来选择的，并且当前块 使用所选择的基于阶梯的变换或基于正弦曲线的变换进行编码。 可以实现具有锋利边缘的块的改进的外观，并且可以使用基于阶梯的变换来进行无损编码。

公开(公告)号：US20160037174A1

公开(公告)日：2016-02-04

申请号：US14884080

申请日：2015-10-15

Applicant: Google Inc.

Inventor： Qunshan Gu ,  Yaowu Xu

IPC: H04N19/176 ,  H04N19/513 ,  H04N19/44 ,  H04N19/61 ,  H04N19/172 ,  H04N19/182

CPC classification number: H04N19/176 ,  H04N19/172 ,  H04N19/182 ,  H04N19/44 ,  H04N19/513 ,  H04N19/593 ,  H04N19/61

Abstract: Second-order orthogonal spatial intra-prediction may include generating a reconstructed frame by generating a plurality of reconstructed blocks by decoding a portion of the current encoded frame, generating a decoded residual block by decoding a current block from the current encoded frame, identifying a current pixel location in the current block, identifying reconstructed pixels in respective reconstructed blocks, wherein first and second reconstructed pixels are at respective oblique angle to the current pixel location, and a third reconstructed pixel at the second oblique angle to the first reconstructed pixel or at the first oblique angle to the second reconstructed pixel, determining a predictor pixel for the current pixel location using a difference between the third reconstructed pixel and a sum of the first reconstructed pixel and the second reconstructed pixel, and identifying a reconstructed pixel as a sum of the predictor pixel and a corresponding residual pixel.

Abstract translation: 二阶正交空间帧内预测可以包括通过对当前编码帧的一部分进行解码来生成多个重构块来产生重构帧，通过从当前编码帧解码当前块来生成解码残差块，识别当前编码帧 在当前块中的像素位置，识别各个重建块中的重建像素，其中第一和第二重构像素与当前像素位置成倾斜角度，以及与第一重建像素成第二倾斜角度的第三重建像素， 使用第三重建像素与第一重建像素和第二重构像素的和之间的差确定当前像素位置的预测像素，并将重构像素识别为第二重构像素的和， 预测像素和相应的残差像素。

公开(公告)号：US20150110409A1

公开(公告)日：2015-04-23

申请号：US14057554

申请日：2013-10-18

Applicant: Google Inc.

Inventor： Ronald Sebastiaan Bultje ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/13

CPC classification number: H04N19/13 ,  H04N19/129 ,  H04N19/91

Abstract: Encoding and decoding using spatial proximity context entropy coding may include identifying a plurality of transform coefficients for a current block of a current frame of a video stream, wherein the plurality of transform coefficients is ordered based on a scan order, identifying a current transform coefficient from the plurality of transform coefficients, identifying a plurality of context coefficients from the plurality of transform coefficients, wherein each context coefficient from the plurality of context coefficients is spatially proximate to the current transform coefficient and is available for entropy coding the current transform coefficient, identifying an entropy coding probability for the current transform coefficient based on the scan order and the plurality of context coefficients, entropy coding the current transform coefficient based on the entropy coding probability, including the entropy coded current transform coefficient in an output bitstream, and storing or transmitting the output bitstream.

Abstract translation: 使用空间邻近度上下文熵编码的编码和解码可以包括识别视频流的当前帧的当前块的多个变换系数，其中基于扫描顺序对多个变换系数进行排序，从而从 所述多个变换系数从所述多个变换系数中识别多个上下文系数，其中来自所述多个上下文系数的每个上下文系数在空间上接近于当前变换系数，并且可用于对当前变换系数进行熵编码， 基于扫描顺序和多个上下文系数的当前变换系数的熵编码概率，基于熵编码概率熵编码当前变换系数，包括输出比特流中的熵编码电流变换系数，以及存储或者转换 忽略输出比特流。

公开(公告)号：US20140098855A1

公开(公告)日：2014-04-10

申请号：US13647092

申请日：2012-10-08

Applicant: Google Inc.

Inventor： Qunshan Gu ,  Yaowu Xu

IPC: H04N7/32 ,  H04N7/26

CPC classification number: H04N19/12 ,  H04N19/139 ,  H04N19/176 ,  H04N19/61

Abstract: Blocks of a frame of a video stream can be encoded using lossless inter-frame prediction encoding. The compression ratio of lossless inter-frame encoding can be improved by first examining the magnitude of a motion vector used to perform inter-frame prediction. If the magnitude of the motion vector is small, the residual generated by the inter-prediction can be entropy coded and included in the encoded bitstream. If the magnitude of the motion vector is greater than a threshold, the residual can be encoded using lossy encoding and then decoded and subtracted from the original residual. The resulting difference residual is encoded using lossless encoding and included in the output bitstream along with the lossy encoded residual, permitting the block to be decoded with no loss at a decoder.

Abstract translation: 可以使用无损帧间预测编码对视频流的帧的块进行编码。 通过首先检查用于执行帧间预测的运动矢量的大小，可以改善无损帧间编码的压缩比。 如果运动矢量的大小小，则由帧间预测产生的残差可以被熵编码并包含在编码比特流中。 如果运动矢量的大小大于阈值，则可以使用有损编码对残差进行编码，然后从原始残差中进行解码和减去。 所得到的差分残差使用无损编码进行编码，并包含在输出比特流中以及有损编码残差，允许在解码器处无损耗地对该块进行解码。

公开(公告)号：US20140098854A1

公开(公告)日：2014-04-10

申请号：US13647089

申请日：2012-10-08

Applicant: GOOGLE INC.

Inventor： Qunshan Gu ,  Yaowu Xu

IPC: H04N7/32

CPC classification number: H04N19/593

Abstract: Blocks of a frame of a video stream can be encoded using lossless intra-prediction encoding. The compression ratio of lossless intra-prediction encoding can be improved by performing lossy encoding on the intra-predicted residual. The encoded residual is then decoded and the reconstructed residual is subtracted from the original residual. The resulting difference residual is encoded using lossless encoding and included in the output bitstream along with the lossy encoded residual, permitting the block to be decoded with no loss at a decoder.

Abstract translation: 可以使用无损内部预测编码对视频流的帧的块进行编码。 可以通过对帧内预测残差进行有损编码来提高无损帧内预测编码的压缩比。 然后对编码的残差进行解码，并从原始残差中减去重建的残差。 所得到的差分残差使用无损编码进行编码，并包含在输出比特流中以及有损编码残差，允许在解码器处无损耗地对该块进行解码。

公开(公告)号：US10602176B2

公开(公告)日：2020-03-24

申请号：US15099853

申请日：2016-04-15

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  Jingning Han

IPC: H04N19/513 ,  H04N19/176 ,  H04N19/523 ,  H04N19/159 ,  H04N19/52 ,  H04N19/463 ,  H04N19/44 ,  H04N19/82 ,  H04N19/117 ,  H04L29/06

Abstract: Decoding a video stream may include decoding a first block of a current frame by decoding a first motion vector from the encoded video stream, decoding an identifier of a first interpolation filter from the encoded video stream, and reconstructing the first block using the first motion vector and the first interpolation filter. Decoding a second block of the current frame may include identifying the first motion vector from the first block as a selected motion vector for predicting the second block in response to decoding an inter-prediction mode identifier for decoding the second block, identifying the first interpolation filter as a selected interpolation filter for predicting the second block in response to identifying the first motion vector from the first block as the selected motion vector for predicting the second block, and reconstructing the second block using the first motion vector and the first interpolation filter.

公开(公告)号：US10306258B2

公开(公告)日：2019-05-28

申请号：US15011415

申请日：2016-01-29

Applicant: Google Inc.

Inventor： James Bankoski ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/52 ,  H04N19/119 ,  H04N19/176 ,  H04N19/105 ,  H04N19/513 ,  H04N19/136 ,  H04N19/167 ,  H04N19/44

Abstract: Encoding or decoding a video signal includes determining a first partitioning of at least a portion of a frame before a current frame in a video sequence. The first partitioning is modified to a second partitioning using a motion vector that predicts at least one prediction sub-region of a first region from the first partitioning. The second partitioning is used to encode or decode a current region of the current frame. The current region may be collocated with the first region. The technique eliminates the need to re-partition an entire frame each time, and can be used with both rectangular-shaped block partitioning and partitioning using masks and other partitioning techniques.

公开(公告)号：US10284869B2

公开(公告)日：2019-05-07

申请号：US15718082

申请日：2017-09-28

Applicant: GOOGLE INC.

Inventor： Jingning Han ,  Yaowu Xu ,  James Bankoski ,  Jia Feng

IPC: H04N19/00 ,  H04N19/51 ,  H04N19/196 ,  H04N19/182 ,  H04N19/176

Abstract: Motion field estimation is used to predict motion within video blocks. A current block of a current frame is identified as a projection of a first reference block of a first reference frame onto the current frame. The projection uses a first motion vector of the reference block with respect to a second reference frame. A temporal motion vector candidate is determined for the current block by projecting the current block onto a second reference frame. The temporal motion vector candidate identifies a second reference block. A motion vector selected from a motion vector candidate list is used to generate a prediction block using the selected motion vector. The current block is coded using the prediction block.

公开(公告)号：US10104382B2

公开(公告)日：2018-10-16

申请号：US15651619

申请日：2017-07-17

Applicant: GOOGLE INC.

Inventor： Jingning Han ,  Yaowu Xu ,  Debargha Mukherjee

IPC: H04N19/176 ,  H04N19/42 ,  H04N19/12 ,  H04N19/60 ,  H04N19/159 ,  H04N19/625 ,  H04N19/593 ,  H04N19/61

Abstract: A method and system may identify a video data block using a video codec and apply a transform kernel of a butterfly asymmetric discrete sine transform (ADST) to the video data block in a pipeline.

公开(公告)号：US20180220152A1

公开(公告)日：2018-08-02

申请号：US15420359

申请日：2017-01-31

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Yuxin Liu

IPC: H04N19/573 ,  H04N19/132 ,  H04N19/56

CPC classification number: H04N19/573 ,  H04N19/119 ,  H04N19/132 ,  H04N19/176 ,  H04N19/20 ,  H04N19/56 ,  H04N19/577 ,  H04N19/58

Abstract: Multi-reference compound prediction using masking for encoding and decoding blocks of video frames is described. A mask for segmenting a current block of a current frame of the video sequence into at least a first segment and a second segment is determined using a first set of reference frames. A first predictor using the first set of reference frames is generated for the first segment of the current block. A second predictor is generated for the second segment of the current block using a second set of reference frames, wherein the first set of reference frames is a subset of the second set of reference frames.