公开(公告)号：US09392280B1

公开(公告)日：2016-07-12

申请号：US14158958

申请日：2014-01-20

Applicant: Google Inc.

Inventor： James Bankoski ,  Adrian Grange ,  Paul Wilkins

IPC: H04N7/12 ,  H04N19/51

CPC classification number: H04N19/00715 ,  H04N19/105 ,  H04N19/137 ,  H04N19/176 ,  H04N19/573 ,  H04N19/80

Abstract: A current block and a reference frame used to compress the current block are selected from a bitstream. The reference frame has an alternate reference block created by obtaining a preliminary alternate reference block for the current block, obtaining a predictor block that is generated based on a frame other than the current frame, and creating the alternate reference block when the difference between the two predictors is less than a threshold. The alternate reference block is created by using certain blocks from the sequence of frames that are more different from the preliminary alternate reference block than other non-selected blocks. The current block is decoded using the alternate reference block. In this way, a predictor block that is different from a golden frame predictor is made available when an existing alternate reference block is too similar to the golden frame predictor to be useful.

Abstract translation: 从比特流中选择用于压缩当前块的当前块和参考帧。 参考帧具有通过获得当前块的初步备用参考块而获得的替代参考块，获得基于除了当前帧之外的帧生成的预测块，并且当两者之间的差异 预测指标小于阈值。 通过使用与其他未选择的块更加不同于初始替代参考块的帧序列中的某些块来创建替代参考块。 使用备用参考块对当前块进行解码。 以这种方式，当现有的替代参考块与黄金帧预测器太相似时，使得与黄金帧预测器不同的预测块可用。

公开(公告)号：US09171523B2

公开(公告)日：2015-10-27

申请号：US13837530

申请日：2013-03-15

Applicant: Google Inc.

Inventor： Nicholas Carter ,  James Bankoski

IPC: G09G5/00 ,  G09G5/02 ,  G06T9/00 ,  G09G5/36 ,  H04N11/20 ,  H04N11/00 ,  H04N5/46 ,  G03F3/08 ,  G06K9/00 ,  G06K9/36 ,  H04N7/01 ,  H04N1/64 ,  H04N9/64

CPC classification number: G09G5/02 ,  H04N1/646 ,  H04N7/01 ,  H04N9/64

Abstract: Disclosed is a method including converting, during a first pass, video data from a first multi-component format to an intermediate multi-component format, the intermediate multi-component format including a first video component, the intermediate multi-component format including a second video component interleaved with a third video component, and converting, during a second pass, the video data from the intermediate multi-component format to a second multi-component format by de-interleaving the second component and third component.

Abstract translation: 公开了一种方法，包括在第一遍期间将来自第一多分量格式的视频数据转换为中间多分量格式，所述中间多分量格式包括第一视频分量，所述中间多分量格式包括第二 视频分量与第三视频分量交织，并且在第二次传送期间，通过对第二分量和第三分量进行解交织，将视频数据从中间多分量格式转换成第二多分量格式。

公开(公告)号：US10448013B2

公开(公告)日：2019-10-15

申请号：US15387690

申请日：2016-12-22

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Jingning Han ,  Yuxin Liu ,  Wei-Ting Lin

IPC: H04N19/117 ,  H04N19/105 ,  H04N19/56 ,  H04N19/134 ,  H04N19/137

Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.

公开(公告)号：US10165306B2

公开(公告)日：2018-12-25

申请号：US15186800

申请日：2016-06-20

Applicant: Google Inc.

Inventor： James Bankoski ,  Yaowu Xu ,  Paul Wilkins

IPC: H04B1/66 ,  H04N7/12 ,  H04N19/80 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/172 ,  H04N19/61 ,  H04N19/107 ,  H04N19/117 ,  H04N19/127 ,  H04N19/179 ,  H04N19/23 ,  H04N19/527

Abstract: Decoding an encoded video stream may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, a decoded video for presentation to a user, and outputting the decoded video. Generating the decoded video may include receiving an encoded video stream, generating a decoded constructed reference frame by decoding an encoded constructed reference frame from the encoded video stream, generating a decoded current frame by decoding an encoded current frame from the encoded video stream using the decoded constructed reference frame as a reference frame, and including the decoded current frame in the decoded video such that the decoded constructed reference frame is omitted from the decoded video.

公开(公告)号：US20180184086A1

公开(公告)日：2018-06-28

申请号：US15387690

申请日：2016-12-22

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Jingning Han ,  Yuxin Liu ,  Wei-Ting Lin

IPC: H04N19/117 ,  H04N19/105 ,  H04N19/56

CPC classification number: H04N19/117 ,  H04N19/105 ,  H04N19/134 ,  H04N19/137 ,  H04N19/56

Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.

公开(公告)号：US20170223377A1

公开(公告)日：2017-08-03

申请号：US15011415

申请日：2016-01-29

Applicant: Google Inc.

Inventor： James Bankoski ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/52 ,  H04N19/167 ,  H04N19/176 ,  H04N19/44

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/119 ,  H04N19/136 ,  H04N19/167 ,  H04N19/176 ,  H04N19/44 ,  H04N19/513

Abstract: Encoding or decoding a video signal includes determining a first partitioning of at least a portion of a frame before a current frame in a video sequence. The first partitioning is modified to a second partitioning using a motion vector that predicts at least one prediction sub-region of a first region from the first partitioning. The second partitioning is used to encode or decode a current region of the current frame. The current region may be collocated with the first region. The technique eliminates the need to re-partition an entire frame each time, and can be used with both rectangular-shaped block partitioning and partitioning using masks and other partitioning techniques.

公开(公告)号：US20180270502A1

公开(公告)日：2018-09-20

申请号：US15458403

申请日：2017-03-14

Applicant: Google Inc.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Yuxin Liu

IPC: H04N19/53 ,  H04N19/513

CPC classification number: H04N19/53 ,  H04N19/105 ,  H04N19/109 ,  H04N19/11 ,  H04N19/513 ,  H04N19/573

Abstract: Coding a current block using multi-level compound predictor is disclosed. A method includes generating a first compound predictor by combining at least two predictor blocks for the current block, generating a second predictor for the current block, and combining the first compound predictor and the second predictor to obtain a prediction block for encoding or decoding the current block. An indicator may be sent from the encoder to the decoder to indicate when multi-level compound prediction is used to encode a block.

公开(公告)号：US20170280143A1

公开(公告)日：2017-09-28

申请号：US15081082

申请日：2016-03-25

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Hui Su

IPC: H04N19/174 ,  H04N19/91 ,  H04N19/503 ,  H04N19/65 ,  H04N19/88 ,  H04N19/129 ,  H04N19/103 ,  H04N19/44 ,  H04N19/593

CPC classification number: H04N19/174 ,  H04N19/103 ,  H04N19/129 ,  H04N19/159 ,  H04N19/192 ,  H04N19/44 ,  H04N19/503 ,  H04N19/593 ,  H04N19/65 ,  H04N19/88 ,  H04N19/91

Abstract: Video data streams can be encoded and decoded using inter or intra prediction. The blocks of a frame can be processed based on depth, from the lowest level sub-blocks to the highest level large blocks, and divided into groups of blocks to be inter predicted, blocks having sub-blocks that are to be inter predicted and sub-blocks that are to be intra predicted, and blocks to be intra predicted, and the blocks to be inter predicted are encoded first, the blocks having sub-blocks to be inter predicted and intra predicted encoded second, and the blocks to be intra predicted encoded last. The availability of data from the inter predicted blocks can improve the performance of intra prediction over processing the blocks in the scan order since more pixel data is available for intra prediction of some blocks.

公开(公告)号：US20170223357A1

公开(公告)日：2017-08-03

申请号：US15010594

申请日：2016-01-29

Applicant: Google Inc.

Inventor： James Bankoski ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/132 ,  H04N19/186 ,  H04N19/182 ,  H04N19/593 ,  H04N19/117 ,  H04N19/44 ,  H04N19/176 ,  H04N19/61 ,  H04N19/105 ,  H04N19/52 ,  H04N19/124

Abstract: A mask is generated from a residual that is a difference between pixel values of at least two frames other than a current frame in a video sequence. The mask is then used to encode or decode a current block by inter-prediction. The mask forms an edge of an object within its bounds and can be used to combine different portions of a reference frame into a single block. This can increase coding efficiency.

公开(公告)号：US20160309192A1

公开(公告)日：2016-10-20

申请号：US15186800

申请日：2016-06-20

Applicant: Google Inc.

Inventor： James Bankoski ,  Yaowu Xu ,  Paul Wilkins

IPC: H04N19/80 ,  H04N19/172 ,  H04N19/139 ,  H04N19/176 ,  H04N19/105

CPC classification number: H04N19/80 ,  H04N19/105 ,  H04N19/107 ,  H04N19/117 ,  H04N19/127 ,  H04N19/139 ,  H04N19/172 ,  H04N19/176 ,  H04N19/179 ,  H04N19/23 ,  H04N19/527 ,  H04N19/61

Abstract: Decoding an encoded video stream may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, a decoded video for presentation to a user, and outputting the decoded video. Generating the decoded video may include receiving an encoded video stream, generating a decoded constructed reference frame by decoding an encoded constructed reference frame from the encoded video stream, generating a decoded current frame by decoding an encoded current frame from the encoded video stream using the decoded constructed reference frame as a reference frame, and including the decoded current frame in the decoded video such that the decoded constructed reference frame is omitted from the decoded video.

Abstract translation: 解码编码视频流可以包括响应于非瞬时计算机可读介质上存储的指令，由处理器产生用于呈现给用户的解码视频，并输出解码的视频。 生成解码的视频可以包括接收编码的视频流，通过从编码的视频流解码经编码的构造的参考帧来生成解码的构造的参考帧，通过使用解码的视频流从编码的视频流解码编码的当前帧来生成解码的当前帧 构造的参考帧作为参考帧，并且将解码的当前帧包括在解码视频中，使得解码的构造的参考帧从解码的视频中省略。