公开(公告)号：US10230986B2

公开(公告)日：2019-03-12

申请号：US15165577

申请日：2016-05-26

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  Paul Wilkins ,  James Bankoski

IPC: H04N19/61 ,  H04N19/17 ,  H04N19/51 ,  H04N19/593 ,  H04N19/44 ,  H04N19/436 ,  H04N19/176 ,  H04N19/82 ,  H04N19/91 ,  H04N19/174

Abstract: An apparatus for decoding frames of a compressed video data stream having at least one frame divided into partitions, includes a memory and a processor configured to execute instructions stored in the memory to read partition data information indicative of a partition location for at least one of the partitions, decode a first partition of the partitions that includes a first sequence of blocks, decode a second partition of the partitions that includes a second sequence of blocks identified from the partition data information using decoded information of the first partition.

公开(公告)号：US20170302965A1

公开(公告)日：2017-10-19

申请号：US15130022

申请日：2016-04-15

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  Paul Wilkins ,  James Bankoski

IPC: H04N19/82 ,  H04N19/117 ,  H04N19/176 ,  H04N19/86

CPC classification number: H04N19/82 ,  H04N19/117 ,  H04N19/176 ,  H04N19/192 ,  H04N19/86

Abstract: Adaptive directional loop filtering can reduce the number of blocking artifacts produced by coding a non-perpendicular picture edge in a frame of a video sequence. A directional filter is selected from a set of directional filters based on one of an orientation of the non-perpendicular picture edge or filter data included as part of an encoded video sequence in association with the frame. The selection can include selecting a directional filter based on a directional intra prediction mode used for encoding the block, a filter angle most closely matching an angle explicitly signaled as part of the video sequence, the incremental reduction of the number of blocking artifacts, a threshold value for blocking artifacts, or a frequency of filter use. Each directional filter of the set of directional filters can have a filter angle between 0 and 180 degrees, exclusive.

公开(公告)号：US10448013B2

公开(公告)日：2019-10-15

申请号：US15387690

申请日：2016-12-22

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Jingning Han ,  Yuxin Liu ,  Wei-Ting Lin

IPC: H04N19/117 ,  H04N19/105 ,  H04N19/56 ,  H04N19/134 ,  H04N19/137

Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.

公开(公告)号：US10165306B2

公开(公告)日：2018-12-25

申请号：US15186800

申请日：2016-06-20

Applicant: Google Inc.

Inventor： James Bankoski ,  Yaowu Xu ,  Paul Wilkins

IPC: H04B1/66 ,  H04N7/12 ,  H04N19/80 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/172 ,  H04N19/61 ,  H04N19/107 ,  H04N19/117 ,  H04N19/127 ,  H04N19/179 ,  H04N19/23 ,  H04N19/527

Abstract: Decoding an encoded video stream may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, a decoded video for presentation to a user, and outputting the decoded video. Generating the decoded video may include receiving an encoded video stream, generating a decoded constructed reference frame by decoding an encoded constructed reference frame from the encoded video stream, generating a decoded current frame by decoding an encoded current frame from the encoded video stream using the decoded constructed reference frame as a reference frame, and including the decoded current frame in the decoded video such that the decoded constructed reference frame is omitted from the decoded video.

公开(公告)号：US20180184086A1

公开(公告)日：2018-06-28

申请号：US15387690

申请日：2016-12-22

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Jingning Han ,  Yuxin Liu ,  Wei-Ting Lin

IPC: H04N19/117 ,  H04N19/105 ,  H04N19/56

CPC classification number: H04N19/117 ,  H04N19/105 ,  H04N19/134 ,  H04N19/137 ,  H04N19/56

Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.

公开(公告)号：US20170310973A1

公开(公告)日：2017-10-26

申请号：US15138397

申请日：2016-04-26

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  Paul Wilkins

IPC: H04N19/159 ,  H04N19/182 ,  H04N19/176

CPC classification number: H04N19/159 ,  H04N19/107 ,  H04N19/119 ,  H04N19/147 ,  H04N19/176 ,  H04N19/182 ,  H04N19/593

Abstract: A prediction block is determined for a current block of a current frame of a video stream using a template having pixel locations that conform to a subset of the pixel locations of the current block. A first portion of the prediction block having the same pattern of pixel locations as the template is populated by inter-predicted pixel values, and the remaining portion of the prediction block is populated by intra-predicted pixel values. The intra-predicted pixel values may be determined using inter-predicted pixel values of the first portion, pixel values of pixels adjacent to the current block, or both.

公开(公告)号：US09172957B2

公开(公告)日：2015-10-27

申请号：US14195160

申请日：2014-03-03

Applicant: Google Inc.

Inventor： Adrian Grange ,  Paul Wilkins ,  Francis William Galligan

IPC: H04N7/12 ,  H04N19/503 ,  H04N19/61 ,  H04N19/00 ,  H04N19/176 ,  H04N19/86 ,  H04N19/159 ,  H04N19/117 ,  H04N19/194 ,  H04N19/80 ,  H04N19/85 ,  H04N19/40

CPC classification number: H04N19/503 ,  H04N19/117 ,  H04N19/159 ,  H04N19/176 ,  H04N19/194 ,  H04N19/40 ,  H04N19/44 ,  H04N19/61 ,  H04N19/63 ,  H04N19/80 ,  H04N19/85

Abstract: Implementations of the teachings herein include coding video data with an alternate reference frame generated using a temporal filter. The alternate reference frame is generated by determining a first weighting factor, for each corresponding block of a respective frame of a filter set, that represents a temporal correlation of the block with the corresponding block, determining a second weighting factor, for each pixel for each corresponding block of the respective frame of the filter set, that represents a temporal correlation of the pixel to a spatially-correspondent pixel in the block, determining a filter weight for each pixel in the block and for each spatially-correspondent pixel is each corresponding block based on the first weighting factor and the second weighting factor, and generating a weighted average pixel value for each pixel position in the block to form a block of the alternate reference frame based on the filter weights.

Abstract translation: 这里的教导的实现包括使用时间滤波器生成的替代参考帧对视频数据进行编码。 通过为滤波器组的相应帧的每个相应块确定第一加权因子来生成替代参考帧，该第一加权因子表示该块与相应块的时间相关性，为每个像素确定每个像素的第二加权因子 滤波器组的相应帧的相应块，其表示像素与块中的空间相应像素的时间相关性，确定块中每个像素和每个空间相应像素的滤波器权重分别是对应块 基于第一加权因子和第二加权因子，并且为块中的每个像素位置生成加权平均像素值，以基于滤波器权重形成替代参考帧的块。

公开(公告)号：US20140177714A1

公开(公告)日：2014-06-26

申请号：US14195160

申请日：2014-03-03

Applicant: Google Inc.

Inventor： Adrian Grange ,  Paul Wilkins ,  Francis William Galligan

IPC: H04N19/503

CPC classification number: H04N19/503 ,  H04N19/117 ,  H04N19/159 ,  H04N19/176 ,  H04N19/194 ,  H04N19/40 ,  H04N19/44 ,  H04N19/61 ,  H04N19/63 ,  H04N19/80 ,  H04N19/85

Abstract: Implementations of the teachings herein include coding video data with an alternate reference frame generated using a temporal filter. The alternate reference frame is generated by determining a first weighting factor, for each corresponding block of a respective frame of a filter set, that represents a temporal correlation of the block with the corresponding block, determining a second weighting factor, for each pixel for each corresponding block of the respective frame of the filter set, that represents a temporal correlation of the pixel to a spatially-correspondent pixel in the block, determining a filter weight for each pixel in the block and for each spatially-correspondent pixel is each corresponding block based on the first weighting factor and the second weighting factor, and generating a weighted average pixel value for each pixel position in the block to form a block of the alternate reference frame based on the filter weights.

Abstract translation: 这里的教导的实现包括使用时间滤波器生成的替代参考帧对视频数据进行编码。 通过为滤波器组的相应帧的每个相应块确定第一加权因子来生成替代参考帧，该第一加权因子表示该块与相应块的时间相关性，为每个像素确定每个像素的第二加权因子 滤波器组的相应帧的相应块，其表示像素与块中的空间相应像素的时间相关性，确定块中每个像素和每个空间相应像素的滤波器权重分别是对应块 基于第一加权因子和第二加权因子，并且为块中的每个像素位置生成加权平均像素值，以基于滤波器权重形成替代参考帧的块。

公开(公告)号：US20170280143A1

公开(公告)日：2017-09-28

申请号：US15081082

申请日：2016-03-25

Applicant: GOOGLE INC.

Inventor： Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Hui Su

IPC: H04N19/174 ,  H04N19/91 ,  H04N19/503 ,  H04N19/65 ,  H04N19/88 ,  H04N19/129 ,  H04N19/103 ,  H04N19/44 ,  H04N19/593

CPC classification number: H04N19/174 ,  H04N19/103 ,  H04N19/129 ,  H04N19/159 ,  H04N19/192 ,  H04N19/44 ,  H04N19/503 ,  H04N19/593 ,  H04N19/65 ,  H04N19/88 ,  H04N19/91

Abstract: Video data streams can be encoded and decoded using inter or intra prediction. The blocks of a frame can be processed based on depth, from the lowest level sub-blocks to the highest level large blocks, and divided into groups of blocks to be inter predicted, blocks having sub-blocks that are to be inter predicted and sub-blocks that are to be intra predicted, and blocks to be intra predicted, and the blocks to be inter predicted are encoded first, the blocks having sub-blocks to be inter predicted and intra predicted encoded second, and the blocks to be intra predicted encoded last. The availability of data from the inter predicted blocks can improve the performance of intra prediction over processing the blocks in the scan order since more pixel data is available for intra prediction of some blocks.

公开(公告)号：US20160309192A1

公开(公告)日：2016-10-20

申请号：US15186800

申请日：2016-06-20

Applicant: Google Inc.

Inventor： James Bankoski ,  Yaowu Xu ,  Paul Wilkins

IPC: H04N19/80 ,  H04N19/172 ,  H04N19/139 ,  H04N19/176 ,  H04N19/105

CPC classification number: H04N19/80 ,  H04N19/105 ,  H04N19/107 ,  H04N19/117 ,  H04N19/127 ,  H04N19/139 ,  H04N19/172 ,  H04N19/176 ,  H04N19/179 ,  H04N19/23 ,  H04N19/527 ,  H04N19/61

Abstract: Decoding an encoded video stream may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, a decoded video for presentation to a user, and outputting the decoded video. Generating the decoded video may include receiving an encoded video stream, generating a decoded constructed reference frame by decoding an encoded constructed reference frame from the encoded video stream, generating a decoded current frame by decoding an encoded current frame from the encoded video stream using the decoded constructed reference frame as a reference frame, and including the decoded current frame in the decoded video such that the decoded constructed reference frame is omitted from the decoded video.

Abstract translation: 解码编码视频流可以包括响应于非瞬时计算机可读介质上存储的指令，由处理器产生用于呈现给用户的解码视频，并输出解码的视频。 生成解码的视频可以包括接收编码的视频流，通过从编码的视频流解码经编码的构造的参考帧来生成解码的构造的参考帧，通过使用解码的视频流从编码的视频流解码编码的当前帧来生成解码的当前帧 构造的参考帧作为参考帧，并且将解码的当前帧包括在解码视频中，使得解码的构造的参考帧从解码的视频中省略。