公开(公告)号：US09866863B1

公开(公告)日：2018-01-09

申请号：US15240258

申请日：2016-08-18

Applicant: Google Inc.

Inventor： Jingning Han ,  Hui Su ,  Yaowu Xu

IPC: H04N11/02 ,  H04N19/52 ,  H04N19/176 ,  H04N19/184 ,  H04N19/91 ,  H04N19/124 ,  H04N19/615

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/124 ,  H04N19/176 ,  H04N19/184 ,  H04N19/54 ,  H04N19/61 ,  H04N19/615 ,  H04N19/91

Abstract: A block of a video frame may be predicted and decoded using a local affine motion prediction scheme. At least three points within the video frame are selected, each point being adjacent to a respective corner of the current block to be encoded. For each point, a motion search is performed for a template block centered about the point within a reference frame to find a template reference block. The template reference block has a center point that forms an anchor point pair with the corresponding point adjacent to the current block. Using coordinates of the anchor point pairs, affine coefficients for an affine transformation are generated. Using the affine transformation, a prediction block for the current block is generated and used to encode the current block within a bitstream. Providing the local affine motion prediction scheme can improve the prediction of certain blocks with complex motion, increasing compression.

公开(公告)号：US20170280143A1

公开(公告)日：2017-09-28

申请号：US15081082

申请日：2016-03-25

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Hui Su

IPC: H04N19/174 ,  H04N19/91 ,  H04N19/503 ,  H04N19/65 ,  H04N19/88 ,  H04N19/129 ,  H04N19/103 ,  H04N19/44 ,  H04N19/593

CPC classification number: H04N19/174 ,  H04N19/103 ,  H04N19/129 ,  H04N19/159 ,  H04N19/192 ,  H04N19/44 ,  H04N19/503 ,  H04N19/593 ,  H04N19/65 ,  H04N19/88 ,  H04N19/91

Abstract: Video data streams can be encoded and decoded using inter or intra prediction. The blocks of a frame can be processed based on depth, from the lowest level sub-blocks to the highest level large blocks, and divided into groups of blocks to be inter predicted, blocks having sub-blocks that are to be inter predicted and sub-blocks that are to be intra predicted, and blocks to be intra predicted, and the blocks to be inter predicted are encoded first, the blocks having sub-blocks to be inter predicted and intra predicted encoded second, and the blocks to be intra predicted encoded last. The availability of data from the inter predicted blocks can improve the performance of intra prediction over processing the blocks in the scan order since more pixel data is available for intra prediction of some blocks.

公开(公告)号：US09544596B1

公开(公告)日：2017-01-10

申请号：US14141778

申请日：2013-12-27

Applicant: GOOGLE INC.

Inventor： Jingning Han ,  Hui Su ,  Yaowu Xu

IPC: H04N11/04 ,  H04N7/26 ,  H04N19/51 ,  H04N19/577 ,  H04N19/583 ,  G06K9/36 ,  H04N19/60

CPC classification number: H04N19/105 ,  H04N19/154 ,  H04N19/182 ,  H04N19/593 ,  H04N19/61 ,  H04N19/82

Abstract: A system includes an encoder and a decoder. The encoder selects a first matched template for un-encoded pixels of a video frame using an algorithm for measuring a similarity between image blocks of the video frame, the algorithm being based on a weighted scheme of reconstructed adjacent pixels, generates at least one residual for the un-encoded pixels of the video frame based on the matched template, and encodes residuals as compressed bits using an asymmetric discrete sine transform (ADST). The decoder decodes the compressed video bits as residuals using the ADST, selects a second matched template using an algorithm for measuring a similarity between image blocks of a video frame associated with the compressed video bits, the algorithm being based on a weighted scheme of reconstructed adjacent pixels, and generates reconstructed pixels of the video frame based on the matched template and the decoded compressed video bits.

Abstract translation: 系统包括编码器和解码器。 编码器使用用于测量视频帧的图像块之间的相似度的算法来选择用于视频帧的未编码像素的第一匹配模板，所述算法基于重构的相邻像素的加权方案，生成至少一个残差 基于匹配模板的视频帧的未编码像素，并且使用不对称离散正弦变换（ADST）将残差编码为压缩比特。 解码器使用ADST将压缩视频位解码为残差，使用用于测量与压缩视频比特相关联的视频帧的图像块之间的相似度的算法来选择第二匹配模板，该算法基于重建的邻近的加权方案 并且基于匹配的模板和解码的压缩视频比特来生成视频帧的重建像素。

公开(公告)号：US11785226B1

公开(公告)日：2023-10-10

申请号：US15487516

申请日：2017-04-14

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  Hui Su

IPC: H04N19/159 ,  H04N19/182 ,  H04N19/176

CPC classification number: H04N19/159 ,  H04N19/176 ,  H04N19/182

Abstract: Adaptive composite intra-prediction may include in response to a determination that a first prediction pixel from a first block immediately adjacent to a first edge of a current block is available for predicting a current pixel of the current block, determining whether a second prediction pixel from a second block immediately adjacent to a second edge of the current block is available for predicting the current pixel, wherein the second edge is opposite the first edge, and, in response to a determination that the second prediction pixel is available, generating a prediction value for the current pixel based on at least one of the first prediction pixel or the second prediction pixel. Adaptive composite intra-prediction may include generating a reconstructed pixel corresponding to the current pixel based on the prediction value, including the reconstructed pixel in the decoded current block, and outputting or storing the decoded current block.

公开(公告)号：US09438910B1

公开(公告)日：2016-09-06

申请号：US14204100

申请日：2014-03-11

Applicant: Google Inc.

Inventor： Jingning Han ,  Hui Su ,  Yaowu Xu

IPC: H04N11/02 ,  H04N19/583 ,  H04N19/61

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/124 ,  H04N19/176 ,  H04N19/184 ,  H04N19/54 ,  H04N19/61 ,  H04N19/615 ,  H04N19/91

Abstract: A block of a video frame may be predicted and encoded using a local affine motion prediction scheme. At least three points within the video frame are selected, each point being adjacent to a respective corner of the current block to be encoded. For each point, a motion search is performed for a template block centered about the point within a reference frame to find a template reference block. The template reference block has a center point that forms an anchor point pair with the corresponding point adjacent to the current block. Using coordinates of the anchor point pairs, affine coefficients for an affine transformation are generated. Using the affine transformation, a prediction block for the current block is generated and used to encode the current block within a bitstream. Providing the local affine motion prediction scheme can improve the prediction of certain blocks with complex motion, increasing compression.

Abstract translation: 可以使用本地仿射运动预测方案来预测和编码视频帧的块。 选择视频帧内的至少三个点，每个点与待编码的当前块的相应角相邻。 对于每个点，对于以参考帧内的点为中心的模板块执行运动搜索以找到模板参考块。 模板参考块具有形成与当前块相邻的对应点的锚点对的中心点。 使用锚点对的坐标，生成仿射变换的仿射系数。 使用仿射变换，生成用于当前块的预测块并用于对比特流内的当前块进行编码。 提供局部仿射运动预测方案可以改善某些具有复杂运动的块的预测，增加压缩。

公开(公告)号：US20170347094A1

公开(公告)日：2017-11-30

申请号：US15168673

申请日：2016-05-31

Applicant: GOOGLE INC.

Inventor： Hui Su ,  Yaowu Xu ,  Jingning Han

IPC: H04N19/11 ,  H04N19/44 ,  H04N19/182 ,  H04N19/593 ,  H04N19/176

CPC classification number: H04N19/11 ,  H04N19/157 ,  H04N19/176 ,  H04N19/182 ,  H04N19/44 ,  H04N19/593

Abstract: Using directional intra prediction modes for encoding and decoding a video stream is described. A method includes identifying, peripheral to a current block of a frame of the video stream, a set of previously coded pixels in the frame, identifying a candidate set of directional intra prediction modes from a plurality of directional intra prediction modes based on a size of the current block, and selecting, for the current block, an optimal intra prediction mode from the candidate set of directional intra prediction modes. The optimal intra prediction mode is used to predict the current block based on the set of previously coded pixels.