公开(公告)号：US09438910B1

公开(公告)日：2016-09-06

申请号：US14204100

申请日：2014-03-11

Applicant: Google Inc.

Inventor： Jingning Han ,  Hui Su ,  Yaowu Xu

IPC: H04N11/02 ,  H04N19/583 ,  H04N19/61

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/124 ,  H04N19/176 ,  H04N19/184 ,  H04N19/54 ,  H04N19/61 ,  H04N19/615 ,  H04N19/91

Abstract: A block of a video frame may be predicted and encoded using a local affine motion prediction scheme. At least three points within the video frame are selected, each point being adjacent to a respective corner of the current block to be encoded. For each point, a motion search is performed for a template block centered about the point within a reference frame to find a template reference block. The template reference block has a center point that forms an anchor point pair with the corresponding point adjacent to the current block. Using coordinates of the anchor point pairs, affine coefficients for an affine transformation are generated. Using the affine transformation, a prediction block for the current block is generated and used to encode the current block within a bitstream. Providing the local affine motion prediction scheme can improve the prediction of certain blocks with complex motion, increasing compression.

Abstract translation: 可以使用本地仿射运动预测方案来预测和编码视频帧的块。 选择视频帧内的至少三个点，每个点与待编码的当前块的相应角相邻。 对于每个点，对于以参考帧内的点为中心的模板块执行运动搜索以找到模板参考块。 模板参考块具有形成与当前块相邻的对应点的锚点对的中心点。 使用锚点对的坐标，生成仿射变换的仿射系数。 使用仿射变换，生成用于当前块的预测块并用于对比特流内的当前块进行编码。 提供局部仿射运动预测方案可以改善某些具有复杂运动的块的预测，增加压缩。

公开(公告)号：US09374578B1

公开(公告)日：2016-06-21

申请号：US13900592

申请日：2013-05-23

Applicant: Google Inc.

Inventor： Debargha Mukherjee ,  Paul Gordon Wilkins ,  Yaowu Xu

IPC: H04N19/176 ,  H04N19/50

CPC classification number: H04N19/00569 ,  H04N19/105 ,  H04N19/157 ,  H04N19/167 ,  H04N19/176 ,  H04N19/182

Abstract: Blocks of a video data stream may be encoded using either intra-frame (intra) prediction or inter-frame (inter) prediction. Combining intra and inter prediction can provide greater compression while maintaining the quality of the decoded video stream. Intra and inter prediction blocks are combined by weighting each block on a pixel-by-pixel basis and adding the weighted pixel values together. Weighting is based on the intra prediction mode. Pixels are weighted to give emphasis to intra predicted pixels closer to the boundaries where the predicted pixels originate and more emphasis to inter predicted pixels further away from the boundaries.

Abstract translation: 可以使用帧内（帧内）预测或帧间（帧间）预测来对视频数据流的块进行编码。 组合帧内和帧间预测可以在保持解码的视频流的质量的同时提供更大的压缩。 帧内和帧间预测块通过逐像素地对每个块进行加权而组合，并将加权像素值相加。 加权是基于帧内预测模式。 像素被加权以强调靠近预测像素起始的边界的帧内预测像素，并且更加强调进一步远离边界的帧间预测像素。

公开(公告)号：US09210432B2

公开(公告)日：2015-12-08

申请号：US13647092

申请日：2012-10-08

Applicant: Google Inc.

Inventor： Qunshan Gu ,  Yaowu Xu

IPC: H04N7/32 ,  H04N19/12 ,  H04N19/139 ,  H04N19/176 ,  H04N19/61

CPC classification number: H04N19/12 ,  H04N19/139 ,  H04N19/176 ,  H04N19/61

Abstract: Blocks of a frame of a video stream can be encoded using lossless inter-frame prediction encoding. The compression ratio of lossless inter-frame encoding can be improved by first examining the magnitude of a motion vector used to perform inter-frame prediction. If the magnitude of the motion vector is small, the residual generated by the inter-prediction can be entropy coded and included in the encoded bitstream. If the magnitude of the motion vector is greater than a threshold, the residual can be encoded using lossy encoding and then decoded and subtracted from the original residual. The resulting difference residual is encoded using lossless encoding and included in the output bitstream along with the lossy encoded residual, permitting the block to be decoded with no loss at a decoder.

Abstract translation: 可以使用无损帧间预测编码对视频流的帧的块进行编码。 通过首先检查用于执行帧间预测的运动矢量的大小，可以改善无损帧间编码的压缩比。 如果运动矢量的大小小，则由帧间预测产生的残差可以被熵编码并包含在编码比特流中。 如果运动矢量的大小大于阈值，则可以使用有损编码对残差进行编码，然后从原始残差中进行解码和减去。 所得到的差分残差使用无损编码进行编码，并包含在输出比特流中以及有损编码残差，允许在解码器处无损耗地对该块进行解码。

公开(公告)号：US09179151B2

公开(公告)日：2015-11-03

申请号：US14057554

申请日：2013-10-18

Applicant: Google Inc.

Inventor： Ronald Sebastiaan Bultje ,  Debargha Mukherjee ,  Yaowu Xu

IPC: G06K9/36 ,  G06K9/46 ,  H04N19/13 ,  H04N19/129 ,  H04N19/91

CPC classification number: H04N19/13 ,  H04N19/129 ,  H04N19/91

Abstract: Encoding and decoding using spatial proximity context entropy coding may include identifying a plurality of transform coefficients for a current block of a current frame of a video stream. The plurality of transform coefficients may be ordered based on a scan order. A current transform coefficient may be identified from the plurality of transform coefficients. A plurality of context coefficients may be identified from the plurality of transform coefficients. Each context coefficient may be spatially proximate to the current transform coefficient and may be available for entropy coding the current transform coefficient. An entropy coding probability for the current transform coefficient may be identified based on the scan order and the plurality of context coefficients. The current transform coefficient may be entropy coded based on the entropy coding probability. The entropy coded current transform coefficient may be included in an output bitstream, which may be stored or transmitted.

Abstract translation: 使用空间邻近度上下文熵编码的编码和解码可以包括识别视频流的当前帧的当前块的多个变换系数。 可以基于扫描顺序对多个变换系数进行排序。 可以从多个变换系数中识别当前变换系数。 可以从多个变换系数中识别多个上下文系数。 每个上下文系数可以在空间上接近当前变换系数，并且可用于对当前变换系数进行熵编码。 可以基于扫描顺序和多个上下文系数来识别当前变换系数的熵编码概率。 可以基于熵编码概率对当前变换系数进行熵编码。 熵编码的电流变换系数可以包括在可以存储或发送的输出比特流中。

公开(公告)号：US20150055706A1

公开(公告)日：2015-02-26

申请号：US13974678

申请日：2013-08-23

Applicant: Google Inc.

Inventor： Yaowu Xu ,  Paul Gordon Wilkins ,  Adrian William Grange ,  Ronald Sebastiaan Bultje

IPC: H04N7/36

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/117 ,  H04N19/124 ,  H04N19/13 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/46 ,  H04N19/61

Abstract: Techniques are described to use a reference motion vector to reduce the amount of bits needed to encode motion vectors for inter prediction. One method includes identifying a candidate motion vector used to inter predict each of a plurality of previously coded blocks to define a plurality of candidate motion vectors, identifying a set of reconstructed pixel values corresponding to a set of previously coded pixels for the current block, and generating, using each candidate motion vector, a corresponding set of predicted values for the set of previously coded pixel values within each reference frame of a plurality of reference frames. A respective error value based on a difference between the set of reconstructed pixel values and each set of predicted values is used to select a reference motion vector from the candidate motion vectors that is used to encode the motion vector for the current block.

Abstract translation: 描述技术以使用参考运动矢量来减少编码用于帧间预测的运动矢量所需的位数量。 一种方法包括识别用于相互预测多个先前编码块中的每一个的候选运动矢量，以定义多个候选运动矢量，识别与当前块的一组先前编码像素相对应的一组重建像素值，以及 使用每个候选运动矢量生成多个参考帧的每个参考帧内的先前编码的像素值集合的相应的一组预测值。 使用基于重构像素值集合和每组预测值之间的差的相应误差值从用于编码当前块的运动矢量的候选运动矢量中选择参考运动矢量。

公开(公告)号：US10244261B2

公开(公告)日：2019-03-26

申请号：US15415974

申请日：2017-01-26

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  Jingning Han ,  Ching-Han Chiang

IPC: H04N19/129 ,  H04N19/60 ,  H04N19/44 ,  H04N19/18 ,  H04N19/88 ,  G06K9/00 ,  G08B13/196 ,  H04N5/232 ,  H04N19/48 ,  H04N19/645 ,  H04N19/70 ,  H04N19/13 ,  H04N19/91 ,  H04N19/157

Abstract: A method for encoding a transform block in an encoded video bitstream is provided. The method includes encoding a non-zero map indicating positions of the transform block containing non-zero transform coefficients, encoding a respective lower-range level map, and encoding a coefficient residual map. A lower-range level map indicates which values of the non-zero transform coefficients are equal to and which are greater than the map level. Each residual coefficient of the coefficient residual map corresponds to a respective non-zero transform coefficient of the transform block having an absolute value exceeding the maximum map level. An apparatus including a processor and a memory for decoding a transform block is also provided. The memory includes instructions executable by the processor to decode, a non-zero map, decode lower-range level maps up to a maximum map level, and decode a coefficient residual map.

公开(公告)号：US10142647B2

公开(公告)日：2018-11-27

申请号：US14540083

申请日：2014-11-13

Applicant: Google Inc.

Inventor： Jingning Han ,  Yaowu Xu

IPC: H04N19/503 ,  H04N19/82 ,  H04N19/176 ,  H04N19/103 ,  H04N19/136 ,  H04N19/157

Abstract: A method and apparatus for video coding using alternating block constrained decision mode coding is provided. Video coding using alternating block constrained decision mode coding may include identifying a current block of a current frame of an input video stream, generating an encoded block by encoding the current block using alternating block constrained decision mode coding, wherein alternating block constrained decision mode coding includes encoding the current block as a constrained decision mode coded block on a condition that a previously coded immediately adjacent block is an unconstrained decision mode coded block, including the encoded block in an output bitstream, and transmitting or storing the output bitstream.

公开(公告)号：US20180270502A1

公开(公告)日：2018-09-20

申请号：US15458403

申请日：2017-03-14

Applicant: Google Inc.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Yuxin Liu

IPC: H04N19/53 ,  H04N19/513

CPC classification number: H04N19/53 ,  H04N19/105 ,  H04N19/109 ,  H04N19/11 ,  H04N19/513 ,  H04N19/573

Abstract: Coding a current block using multi-level compound predictor is disclosed. A method includes generating a first compound predictor by combining at least two predictor blocks for the current block, generating a second predictor for the current block, and combining the first compound predictor and the second predictor to obtain a prediction block for encoding or decoding the current block. An indicator may be sent from the encoder to the decoder to indicate when multi-level compound prediction is used to encode a block.

公开(公告)号：US20180213258A1

公开(公告)日：2018-07-26

申请号：US15415974

申请日：2017-01-26

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  Jingning Han ,  Ching-Han Chiang

IPC: H04N19/60 ,  H04N19/44 ,  H04N19/18 ,  H04N19/88

CPC classification number: H04N19/60 ,  G06K9/00362 ,  G06K9/00624 ,  G06K9/00711 ,  G06K9/00771 ,  G06K9/00778 ,  G08B13/19602 ,  G08B13/19604 ,  H04N5/23238 ,  H04N19/129 ,  H04N19/13 ,  H04N19/157 ,  H04N19/18 ,  H04N19/44 ,  H04N19/48 ,  H04N19/645 ,  H04N19/70 ,  H04N19/88 ,  H04N19/91

Abstract: A method for encoding a transform block in an encoded video bitstream is provided. The method includes encoding a non-zero map indicating positions of the transform block containing non-zero transform coefficients, encoding a respective lower-range level map, and encoding a coefficient residual map. A lower-range level map indicates which values of the non-zero transform coefficients are equal to and which are greater than the map level. Each residual coefficient of the coefficient residual map corresponds to a respective non-zero transform coefficient of the transform block having an absolute value exceeding the maximum map level. An apparatus including a processor and a memory for decoding a transform block is also provided. The memory includes instructions executable by the processor to decode, a non-zero map, decode lower-range level maps up to a maximum map level, and decode a coefficient residual map.

公开(公告)号：US20170280143A1

公开(公告)日：2017-09-28

申请号：US15081082

申请日：2016-03-25

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Hui Su

IPC: H04N19/174 ,  H04N19/91 ,  H04N19/503 ,  H04N19/65 ,  H04N19/88 ,  H04N19/129 ,  H04N19/103 ,  H04N19/44 ,  H04N19/593

CPC classification number: H04N19/174 ,  H04N19/103 ,  H04N19/129 ,  H04N19/159 ,  H04N19/192 ,  H04N19/44 ,  H04N19/503 ,  H04N19/593 ,  H04N19/65 ,  H04N19/88 ,  H04N19/91

Abstract: Video data streams can be encoded and decoded using inter or intra prediction. The blocks of a frame can be processed based on depth, from the lowest level sub-blocks to the highest level large blocks, and divided into groups of blocks to be inter predicted, blocks having sub-blocks that are to be inter predicted and sub-blocks that are to be intra predicted, and blocks to be intra predicted, and the blocks to be inter predicted are encoded first, the blocks having sub-blocks to be inter predicted and intra predicted encoded second, and the blocks to be intra predicted encoded last. The availability of data from the inter predicted blocks can improve the performance of intra prediction over processing the blocks in the scan order since more pixel data is available for intra prediction of some blocks.