公开(公告)号：US20200007890A1

公开(公告)日：2020-01-02

申请号：US16561165

申请日：2019-09-05

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  Yaowu Xu

IPC: H04N19/573 ,  H04N19/52 ,  H04N19/107 ,  H04N19/172 ,  H04N19/176 ,  H04N19/91 ,  H04N19/82 ,  H04N19/86 ,  H04N19/61 ,  H04N19/70 ,  H04N19/126 ,  H04N5/225 ,  H04N19/567 ,  H04N19/577

Abstract: A prediction scheme is selected for encoding or decoding a video block. A first compound motion block can be determined by weighting distances from a first reference frame to the video frame and from a second reference frame to the video frame using one or more quantized weighting coefficients. A second compound motion block can be determined based on an average of pixel values a video block of the first reference frame and pixel values from a video block of the second reference frame. One of the first compound motion block or the second compound motion block is selected and used to generate a prediction block. Alternatively, data encoded to a bitstream including the video frame can be used to determine which compound motion block to use to generate the prediction block. The current block of the video frame is then encoded or decoded using the prediction block.

公开(公告)号：US10523944B2

公开(公告)日：2019-12-31

申请号：US16402411

申请日：2019-05-03

Applicant: GOOGLE LLC

Inventor： Ching-Han Chiang ,  Yaowu Xu ,  Jingning Han ,  Jia Feng

IPC: H04N19/00 ,  H04N19/129 ,  H04N19/159 ,  H04N19/61 ,  H04N19/86 ,  H04N19/13 ,  H04N19/82 ,  H04N19/124 ,  H04N19/156 ,  H04N19/18 ,  H04N19/423 ,  H04N19/91 ,  H04N7/18 ,  H04N11/00

Abstract: Generating a new scan order includes incrementing a next index value after assigning the next index value to a coefficient in the new scan order; assigning, to a first coefficient at a first scan index m in the original scan order, a first scan index in the new scan order, the first coefficient is a context coefficient for entropy coding a parent coefficient that is at a parent scan index n in the original scan order; adding, to a list, a first item indicative of the parent coefficient and parent scan index n; before assigning a second scan index to a second coefficient that is at a second index m+j in the original scan order, wherein j>1, assigning the next index value to the parent coefficient, and removing the first item from the list; and assigning the next index value to the second coefficient in the new scan order.

公开(公告)号：US20190394463A1

公开(公告)日：2019-12-26

申请号：US16016768

申请日：2018-06-25

Applicant: GOOGLE LLC

Inventor： Cheng Chen ,  Jingning Han ,  Yaowu Xu

IPC: H04N19/117 ,  H04N19/176 ,  H04N19/46 ,  H04N19/186

Abstract: Systems and methods are disclosed for encoding and decoding video. For example, methods may include: accessing an encoded bitstream; reconstructing an image including multiple color planes based on data from the encoded bitstream; decoding a first filter level from the encoded bitstream, wherein the first filter level specifies one or more thresholds that are used to select a length for a deblocking filter; decoding a second filter level from the encoded bitstream, wherein the second filter level specifies one or more thresholds that are used to select a length for a deblocking filter; after reconstruction of the image, applying a deblocking filter to a first color plane of the image using the first filter level; and, after reconstruction of the image, applying a deblocking filter to a second color plane of the image using the second filter level.

公开(公告)号：US20190342559A1

公开(公告)日：2019-11-07

申请号：US16512478

申请日：2019-07-16

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Hui Su

IPC: H04N19/174 ,  H04N19/91 ,  H04N19/593 ,  H04N19/129 ,  H04N19/159 ,  H04N19/65 ,  H04N19/88 ,  H04N19/103 ,  H04N19/44 ,  H04N19/503

Abstract: Video data streams can be encoded and decoded using inter or intra prediction. The blocks of a frame can be processed based on depth, from the lowest level sub-blocks to the highest level large blocks, and divided into groups of blocks that are inter predicted, blocks having sub-blocks that are inter predicted and sub-blocks that are intra predicted, and blocks that are intra predicted. The inter predicted blocks are encoded or decoded first, followed by the inter predicted sub-blocks, the intra predicted sub-blocks, and the intra predicted blocks. Data from the inter predicted blocks and sub-blocks may be used to improve the prediction performance of intra predicted blocks and sub-blocks.

公开(公告)号：US10469841B2

公开(公告)日：2019-11-05

申请号：US15010594

申请日：2016-01-29

Applicant: GOOGLE LLC

Inventor： James Bankoski ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/132 ,  H04N19/186 ,  H04N19/182 ,  H04N19/593 ,  H04N19/117 ,  H04N19/44 ,  H04N19/176 ,  H04N19/105 ,  H04N19/119 ,  H04N19/137 ,  H04N19/543 ,  H04N19/124 ,  H04N19/52 ,  H04N19/61

Abstract: A mask is generated from a residual that is a difference between pixel values of at least two frames other than a current frame in a video sequence. The mask is then used to encode or decode a current block by inter-prediction. The mask forms an edge of an object within its bounds and can be used to combine different portions of a reference frame into a single block. This can increase coding efficiency.

公开(公告)号：US10462457B2

公开(公告)日：2019-10-29

申请号：US15373518

申请日：2016-12-09

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Jingning Han

IPC: H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/52 ,  H04N19/109

Abstract: Techniques are described to use a reference motion vector to reduce the amount of bits needed to encode motion vectors for inter prediction. A dynamic motion vector coding mode generates a ranked list of motion vector candidates using a distance between previously coded blocks and a current block, and the frequency of use of the motion vectors of those previously coded blocks. The list is used to assign the effective motion vectors to different inter-prediction modes, including a variable number of reference motion vector modes.

公开(公告)号：US20190327484A1

公开(公告)日：2019-10-24

申请号：US16456289

申请日：2019-06-28

Applicant: GOOGLE LLC

Inventor： Adrian William Grange ,  Ronald Sebastiaan Bultje ,  Yaowu Xu ,  Paul Gordon Wilkins

IPC: H04N19/52 ,  H04N19/61 ,  H04N19/13 ,  H04N19/105 ,  H04N19/117 ,  H04N19/46 ,  H04N19/159 ,  H04N19/124

Abstract: Decoding a video sequence may include generating decoded video data by decoding encoded video data from an encoded bitstream, wherein decoding the encoded video data includes identifying candidate reference motion vectors used to decode previously decoded blocks, identifying reconstructed pixel values from a block spatially adjacent to a current block in the current frame, for each candidate reference motion vector, determining a respective score based on a difference between the reconstructed pixel values and pixel values obtained using the candidate reference motion vector, identifying a candidate reference motion vector having the minimal score from the candidate reference motion vectors as the reference motion vector, decoding a motion vector from the encoded bitstream using the reference motion vector, and decoding the current block from the encoded bitstream using the motion vector.

公开(公告)号：US20190268598A1

公开(公告)日：2019-08-29

申请号：US16402411

申请日：2019-05-03

Applicant: GOOGLE LLC

Inventor： Ching-Han Chiang ,  Yaowu Xu ,  Jingning Han ,  Jia Feng

IPC: H04N19/129 ,  H04N19/124 ,  H04N19/82 ,  H04N19/13 ,  H04N19/86 ,  H04N19/91 ,  H04N19/159 ,  H04N19/423 ,  H04N19/18 ,  H04N19/156 ,  H04N19/61

Abstract: Generating a new scan order includes incrementing a next index value after assigning the next index value to a coefficient in the new scan order; assigning, to a first coefficient at a first scan index m in the original scan order, a first scan index in the new scan order, the first coefficient is a context coefficient for entropy coding a parent coefficient that is at a parent scan index n in the original scan order; adding, to a list, a first item indicative of the parent coefficient and parent scan index n; before assigning a second scan index to a second coefficient that is at a second index m+j in the original scan order, wherein j>1, assigning the next index value to the parent coefficient, and removing the first item from the list; and assigning the next index value to the second coefficient in the new scan order.

公开(公告)号：US10397600B1

公开(公告)日：2019-08-27

申请号：US15131079

申请日：2016-04-18

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Jingning Han

IPC: G06T7/20 ,  G06T9/00 ,  H04N19/44 ,  H04N19/52 ,  H04N19/109 ,  H04N19/139 ,  H04N19/159 ,  H04N19/179 ,  H04N19/527 ,  H04N19/176

Abstract: Techniques are described to use a reference motion vector to reduce the amount of bits needed to encode motion vectors for inter prediction. One method includes identifying a candidate motion vector used to inter predict each of a plurality of previously coded blocks to define a plurality of candidate motion vectors, determining a distance between the previously decoded block associated with the candidate motion vector and a current block, determining a popularity value for each candidate motion vector based on a set of previously coded pixels associated with the candidate motion vector, and ranking the candidate motion vectors according to a priority value for each candidate motion vector. The priority value, based on the distance and the popularity value associated with the candidate motion vector, is used to select a reference motion vector from the candidate motion vectors that is used to encode the motion vector for the current block.

公开(公告)号：US20190158873A1

公开(公告)日：2019-05-23

申请号：US15893978

申请日：2018-02-12

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Jingning Han ,  Ching-Han Chiang

IPC: H04N19/573 ,  H04N19/176 ,  H04N19/182 ,  H04N19/44

Abstract: A motion-field based reference frame is rendered that can be used to perform a prediction process for a first frame of a video sequence to be predicted. A first reference frame from the video sequence for forward inter prediction of the first frame is determined, as is a second reference frame from the video sequence for backward inter prediction of the first frame. A respective motion field determined for blocks of the first frame is used to determine parameters forming an affine homographic model. A current block of a reconstructed reference frame is rendered at a co-located position within a motion field-based reference frame by applying the affine homographic model to the current block. An affine homographic model may be determined for each reconstructed reference frame block to render the motion-field based reference frame.