公开(公告)号：US11350102B2

公开(公告)日：2022-05-31

申请号：US16866591

申请日：2020-05-05

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Bohan Li ,  Jingning Han

IPC: H04N19/00 ,  H04N19/139 ,  H04N19/105 ,  H04N19/577 ,  H04N19/573 ,  H04N19/172 ,  H04N19/537

Abstract: Decoding a current block of a current frame includes selecting a first reference frame for forward inter prediction of the current frame; selecting a second reference frame for backward inter prediction of the current frame; generating an optical flow reference frame portion for inter prediction of the current block by performing an optical flow estimation using the first reference frame and the second reference frame, where the optical flow estimation produces a respective motion field for pixels of the current block; and performing a prediction process for the current block using the optical flow reference frame portion by: using a motion vector used to encode the current block to identify a reference block; adjusting boundaries of the reference block using a subpixel interpolation filter length; and identifying blocks encompassing pixels within the adjusted boundaries of the reference block.

公开(公告)号：US20220132116A1

公开(公告)日：2022-04-28

申请号：US17570533

申请日：2022-01-07

Applicant: GOOGLE LLC

Inventor： Eric Ameres ,  James Bankoski ,  Scott Lavarnway ,  Yaowu Xu ,  Dan Miller ,  Adrian Grange ,  Paul Wilkins

IPC: H04N19/117 ,  H04N19/52 ,  H04N19/139 ,  H04N19/172 ,  H04N19/13 ,  H04N19/129 ,  H04N19/114 ,  H04N19/14 ,  H04N19/152 ,  H04N19/154 ,  H04N19/156 ,  H04N19/177 ,  H04N19/523

Abstract: Video coding may include identifying an input frame from an input video stream, generating, by a processor, an output bitstream by encoding the input frame, wherein encoding the input frame includes dividing the input frame into at least a first contiguous area of the input frame and a second contiguous area of the input frame, generating first encoded data by encoding the first contiguous area of the input frame, generating second encoded data by encoding the second contiguous area of the input frame, wherein encoding the second contiguous area of the input frame is performed independently of encoding the first contiguous area of the input frame, and including the first encoded data and the second encoded data in the output bitstream, and outputting the output bitstream.

公开(公告)号：US11153588B2

公开(公告)日：2021-10-19

申请号：US16838529

申请日：2020-04-02

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  Yaowu Xu

IPC: H04N19/85 ,  H04N19/436 ,  H04N19/176 ,  H04N19/86 ,  H04N19/117 ,  H04N19/14 ,  H04N19/82 ,  H04N19/157 ,  H04N19/122

Abstract: An apparatus for video coding using dual deblocking filter thresholds may include a processor generating a reconstructed frame by decoding an encoded bitstream and outputting the reconstructed frame. Decoding may include generating a decoded block by decoding a portion of the encoded bitstream, identifying a first deblocking threshold index from the encoded bitstream, identifying a second deblocking threshold index from the encoded bitstream, generating a reconstructed block based on the decoded block, and including the reconstructed block in the reconstructed frame. Generating the reconstructed block may include deblocking based on the first deblocking threshold index and the second deblocking threshold index.

公开(公告)号：US11025950B2

公开(公告)日：2021-06-01

申请号：US15893978

申请日：2018-02-12

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Jingning Han ,  Ching-Han Chiang

IPC: H04N19/00 ,  H04N19/573 ,  H04N19/567 ,  H04N19/70 ,  H04N19/147 ,  H04N19/51 ,  H04N19/577 ,  H04N19/176 ,  H04N19/182 ,  H04N19/44

Abstract: A motion-field based reference frame is rendered that can be used to perform a prediction process for a first frame of a video sequence to be predicted. A first reference frame from the video sequence for forward inter prediction of the first frame is determined, as is a second reference frame from the video sequence for backward inter prediction of the first frame. A respective motion field determined for blocks of the first frame is used to determine parameters forming an affine homographic model. A current block of a reconstructed reference frame is rendered at a co-located position within a motion field-based reference frame by applying the affine homographic model to the current block. An affine homographic model may be determined for each reconstructed reference frame block to render the motion-field based reference frame.

公开(公告)号：US20200382776A1

公开(公告)日：2020-12-03

申请号：US16995078

申请日：2020-08-17

Applicant: Google LLC

Inventor： Yaowu Xu ,  Jingning Han ,  Cheng Chen

IPC: H04N19/117 ,  H04N19/46 ,  H04N19/186 ,  H04N19/176

Abstract: Techniques for encoding and decoding image data are described. An image is reconstructed and deblocked. A respective deblocking filter is identified for different color planes of the image. The deblocking filters may include those having different lengths for a luma plane as compared to one or more chroma planes of the image. One or more of the color planes, such as the luma plane, may have different filters for filtering reconstructed pixels vertically as compared to filtering the reconstructed pixels horizontally.

公开(公告)号：US10820014B2

公开(公告)日：2020-10-27

申请号：US16561165

申请日：2019-09-05

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  Yaowu Xu

IPC: H04N19/573 ,  H04N19/52 ,  H04N19/107 ,  H04N19/172 ,  H04N19/176 ,  H04N19/91 ,  H04N19/82 ,  H04N19/86 ,  H04N19/61 ,  H04N19/70 ,  H04N19/126 ,  H04N5/225 ,  H04N19/567 ,  H04N19/577

Abstract: A prediction scheme is selected for encoding or decoding a video block. A first compound motion block can be determined by weighting distances from a first reference frame to the video frame and from a second reference frame to the video frame using one or more quantized weighting coefficients. A second compound motion block can be determined based on an average of pixel values a video block of the first reference frame and pixel values from a video block of the second reference frame. One of the first compound motion block or the second compound motion block is selected and used to generate a prediction block. Alternatively, data encoded to a bitstream including the video frame can be used to determine which compound motion block to use to generate the prediction block. The current block of the video frame is then encoded or decoded using the prediction block.

公开(公告)号：US20200236357A1

公开(公告)日：2020-07-23

申请号：US16827864

申请日：2020-03-24

Applicant: GOOGLE LLC

Inventor： Eric Ameres ,  James Bankoski ,  Scott Lavarnway ,  Yaowu Xu ,  Dan Miller ,  Adrian Grange ,  Paul Wilkins

IPC: H04N19/117 ,  H04N19/52 ,  H04N19/139 ,  H04N19/172 ,  H04N19/13 ,  H04N19/129 ,  H04N19/114 ,  H04N19/14 ,  H04N19/152 ,  H04N19/154 ,  H04N19/156 ,  H04N19/177 ,  H04N19/523

Abstract: Video coding may include identifying an input frame from an input video stream, generating, by a processor, an output bitstream by encoding the input frame, wherein encoding the input frame includes dividing the input frame into at least a first contiguous area of the input frame and a second contiguous area of the input frame, generating first encoded data by encoding the first contiguous area of the input frame, generating second encoded data by encoding the second contiguous area of the input frame, wherein encoding the second contiguous area of the input frame is performed independently of encoding the first contiguous area of the input frame, and including the first encoded data and the second encoded data in the output bitstream, and outputting the output bitstream.

公开(公告)号：US10701364B2

公开(公告)日：2020-06-30

申请号：US15794134

申请日：2017-10-26

Applicant: GOOGLE LLC

Inventor： Yuxin Liu ,  Di Chen ,  Yaowu Xu

IPC: H04N19/139 ,  H04N19/172 ,  H04N19/107 ,  H04N19/31 ,  H04N19/177 ,  H04N19/109 ,  H04N19/30

Abstract: Encoding a group of frames of a video sequence can include determining a stillness of the group of frames, in response to determining that the stillness of the group of frames meets stillness conditions, encoding the group of frames using a coding structure that is a one-layer coding structure, and, in response to determining that the stillness of the group of frames does not meet the stillness conditions, encoding the group of frames using the coding structure that is a multi-layer coding structure. Instructions for decoding a group of frames include instructions to determine, from an encoded bitstream, an indication of a coding structure used to encode the group of frames, receive the group of frames in a coding order of the coding structure, and decode the group of frames using the coding structure. The indication is one of a one-layer coding structure indication or a multi-layer coding structure indication.

公开(公告)号：US10326994B2

公开(公告)日：2019-06-18

申请号：US15950225

申请日：2018-04-11

Applicant: GOOGLE LLC

Inventor： Ching-Han Chiang ,  Yaowu Xu ,  Jingning Han ,  Jia Feng

IPC: H04N19/00 ,  H04N19/129 ,  H04N19/159 ,  H04N19/61 ,  H04N19/86 ,  H04N19/13 ,  H04N19/82 ,  H04N19/124

Abstract: A method for coding a transform block of coefficients includes generating a new scan order from the original scan order such that a maximum scan distance of the new scan order is smaller than or equal to a predetermined distance, and coding the coefficients based on the new scan order. An apparatus for decoding a transform block of coefficients. The apparatus includes a memory and a processor. The memory includes instructions executable by the processor to identify an original scan order for encoding the coefficients, generate a new scan order from the original scan order such that a maximum scan distance of the new scan order is less than or equal to a predetermined distance, and decode, from an encoded bitstream, the coefficients based on the new scan order.

公开(公告)号：US20190158843A1

公开(公告)日：2019-05-23

申请号：US15817369

申请日：2017-11-20

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Bohan Li ,  Jingning Han

IPC: H04N19/139 ,  H04N19/105 ,  H04N19/172 ,  H04N19/573 ,  H04N19/577

Abstract: An optical flow reference frame portion (e.g., a block or an entire frame) is generated that can be used for inter prediction of blocks of a current frame in a video sequence. A forward reference frame and a backward reference frame are used in an optical flow estimation that produces a respective motion field for pixels of a current frame. The motion fields are used to warp some or all pixels of the reference frames to the pixels of the current frame. The warped reference frame pixels are blended to form the optical flow reference frame portion. The inter prediction may be performed as part of encoding or decoding portions of the current frame.