公开(公告)号：US11876974B2

公开(公告)日：2024-01-16

申请号：US17738105

申请日：2022-05-06

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Bohan Li ,  Jingning Han

IPC: H04N19/00 ,  H04N19/139 ,  H04N19/105 ,  H04N19/577 ,  H04N19/573 ,  H04N19/172 ,  H04N19/537

CPC classification number: H04N19/139 ,  H04N19/105 ,  H04N19/172 ,  H04N19/537 ,  H04N19/573 ,  H04N19/577

Abstract: Motion prediction using optical flow is determined to be available for a current frame in response to determining that a reference frame buffer includes, with respect to the current frame, a forward reference frame and a backward reference frame. A flag indicating whether a current block is encoded using optical flow is decoded. Responsive to determining that the flag indicates that the current block is encoded using optical flow, a motion vector is decoded for the current block; a location of an optical flow reference block is identified within an optical flow reference frame based on the motion vector; subsequent to identifying the location of the optical flow reference block, the optical flow reference block is generated using the forward reference frame and the backward reference frame without generating the optical flow reference frame; and the current block is decoded based on the optical flow reference block.

公开(公告)号：USRE49615E1

公开(公告)日：2023-08-15

申请号：US17093417

申请日：2020-11-10

Applicant: Google LLC

Inventor： Yaowu Xu ,  Jingning Han

IPC: H04N19/44 ,  H04N19/523 ,  H04L65/70 ,  H04N19/463 ,  H04N19/117 ,  H04N19/176 ,  H04N19/52 ,  H04N19/82 ,  H04N19/159 ,  H04N19/513

CPC classification number: H04N19/44 ,  H04L65/70 ,  H04N19/117 ,  H04N19/159 ,  H04N19/176 ,  H04N19/463 ,  H04N19/513 ,  H04N19/52 ,  H04N19/523 ,  H04N19/82

Abstract: Decoding a video stream may include decoding a first block of a current frame by decoding a first motion vector from the encoded video stream, decoding an identifier of a first interpolation filter from the encoded video stream, and reconstructing the first block using the first motion vector and the first interpolation filter. Decoding a second block of the current frame may include identifying the first motion vector from the first block as a selected motion vector for predicting the second block in response to decoding an inter-prediction mode identifier for decoding the second block, identifying the first interpolation filter as a selected interpolation filter for predicting the second block in response to identifying the first motion vector from the first block as the selected motion vector for predicting the second block, and reconstructing the second block using the first motion vector and the first interpolation filter.

公开(公告)号：US20220353534A1

公开(公告)日：2022-11-03

申请号：US17866612

申请日：2022-07-18

Applicant: Google LLC

Inventor： Yaowu Xu ,  Jingning Han ,  Ching-Han Chiang

IPC: H04N19/60 ,  G06N7/00 ,  G06N20/10 ,  H04N19/12 ,  H04N19/176 ,  H04N19/137 ,  H04N19/463

Abstract: Transform kernel candidates including a vertical transform type associated with a vertical motion and a horizontal transform type associated with a horizontal motion can be encoded or decoded. During a decoding operation, a probability model for decoding encoded bitstream video data associated with a transform kernel candidate for an encoded transform block is identified based on one or both of a first transform kernel candidate selected for an above neighbor transform block of the encoded transform block or a second transform kernel candidate selected for a left neighbor transform block of the encoded transform block. The encoded bitstream video data associated with the transform kernel candidate is decoded using the probability model.

公开(公告)号：US20220303583A1

公开(公告)日：2022-09-22

申请号：US17834972

申请日：2022-06-08

Applicant: GOOGLE LLC

Inventor： James Bankoski ,  Yaowu Xu ,  Paul Wilkins

IPC: H04N19/80 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/172 ,  H04N19/61 ,  H04N19/107 ,  H04N19/117 ,  H04N19/127 ,  H04N19/179 ,  H04N19/23 ,  H04N19/527

Abstract: Video coding using constructed reference frames may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, a reconstructed video. Generating the reconstructed video may include receiving an encoded bitstream. Video coding using constructed reference frames may include generating a reconstructed non-showable reference frame. Generating the reconstructed non-showable reference frame may include decoding a first encoded frame from the encoded bitstream. Video coding using constructed reference frames may include generating a reconstructed frame. Generating the reconstructed frame may include decoding a second encoded frame from the encoded bitstream using the reconstructed non-showable reference frame as a reference frame. Video coding using constructed reference frames may include including the reconstructed frame in the reconstructed video and outputting the reconstructed video.

公开(公告)号：US11284107B2

公开(公告)日：2022-03-22

申请号：US15683684

申请日：2017-08-22

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Bohan Li ,  Jingning Han

IPC: H04N19/58 ,  H04N19/587 ,  H04N19/80 ,  H04N19/176 ,  H04N19/182 ,  H04N19/44 ,  H04N19/59 ,  H04N19/527 ,  H04N19/105 ,  H04N19/567 ,  H04N19/54 ,  H04N19/56 ,  H04N19/523 ,  H04N19/172

Abstract: An optical flow reference frame is generated that can be used for inter prediction of blocks of a current frame in a video sequence. A first (e.g., forward) reference frame and a second (e.g., backward reference frame) are used in an optical flow estimation that produces a respective motion field for pixels of the current frame. The motion fields are used to warp the reference frames to the current frame. The warped reference frames are blended to forms the optical flow reference frame.

公开(公告)号：US11240498B2

公开(公告)日：2022-02-01

申请号：US16827864

申请日：2020-03-24

Applicant: GOOGLE LLC

Inventor： Eric Ameres ,  James Bankoski ,  Scott Lavarnway ,  Yaowu Xu ,  Dan Miller ,  Adrian Grange ,  Paul Wilkins

IPC: H04N19/117 ,  H04N19/52 ,  H04N19/139 ,  H04N19/172 ,  H04N19/13 ,  H04N19/129 ,  H04N19/114 ,  H04N19/14 ,  H04N19/152 ,  H04N19/154 ,  H04N19/156 ,  H04N19/177 ,  H04N19/523

Abstract: Video coding may include identifying an input frame from an input video stream, generating, by a processor, an output bitstream by encoding the input frame, wherein encoding the input frame includes dividing the input frame into at least a first contiguous area of the input frame and a second contiguous area of the input frame, generating first encoded data by encoding the first contiguous area of the input frame, generating second encoded data by encoding the second contiguous area of the input frame, wherein encoding the second contiguous area of the input frame is performed independently of encoding the first contiguous area of the input frame, and including the first encoded data and the second encoded data in the output bitstream, and outputting the output bitstream.

公开(公告)号：US20210112270A1

公开(公告)日：2021-04-15

申请号：US17132065

申请日：2020-12-23

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  James Bankoski ,  Yaowu Xu

IPC: H04N19/573 ,  H04N19/70 ,  H04N19/567 ,  H04N19/52

Abstract: Dynamic motion vector referencing is used to predict motion within video blocks. A motion trajectory is determined for a current frame including a video block to encode or decode based on a reference motion vector used for encoding or decoding one or more reference frames of the current frame. One or more temporal motion vector candidates are then determined for predicting motion within the video block based on the motion trajectory. A motion vector is selected from a motion vector candidate list including the one or more temporal motion vector candidates and used to generate a prediction block. The prediction block is then used to encode or decode the video block. The motion trajectory is based on an order of video frames indicated by frame offset values encoded to a bitstream. The motion vector candidate list may include one or more spatial motion vector candidates.

公开(公告)号：US20210084336A1

公开(公告)日：2021-03-18

申请号：US17106898

申请日：2020-11-30

Applicant: GOOGLE LLC

Inventor： Jingning Han ,  James Zern ,  Linfeng Zhang ,  Ching-Han Chiang ,  Yaowu Xu

IPC: H04N19/60 ,  H04N19/129 ,  H04N19/88 ,  H04N19/184 ,  H04N19/13

Abstract: A processor is configured to maintain, for encoding current values related to the transform coefficients a first line buffer and a second line buffer. The current values are arranged along a current scan-order anti-diagonal line. The first line buffer includes first values of a first scan-order anti-diagonal line. The second line buffer includes second values of a second scan-order anti-diagonal line. The processor is further configured to interleave the first values and the second values in a destination buffer; select, using the destination buffer, a probability distribution for coding a current value of the current values; entropy encode, in a compressed bitstream, the current value using the probability distribution; and replace, for coding values of an immediately subsequent scan-order anti-diagonal line to the current scan-order anti-diagonal line, one of the second line buffer or the first line buffer with the current scan-order anti-diagonal line.

公开(公告)号：US10951921B2

公开(公告)日：2021-03-16

申请号：US16776863

申请日：2020-01-30

Applicant: GOOGLE LLC

Inventor： Yaowu Xu ,  Hui Su

IPC: H04N19/00 ,  H04N19/91 ,  H04N19/184 ,  G06F17/18 ,  H04N19/172 ,  H04N19/177 ,  H04N19/176

Abstract: Generating encoded image data using adjustable per-symbol entropy coding probability updating may include generating a portion of the encoded image data in accordance with a value of a probability update indicator for the portion indicating whether per-symbol entropy coding probability updating is disabled for the portion, and including the value of the probability update indicator and the entropy coded image data in an output bitstream. Generating decoded image data using adjustable per-symbol entropy coding probability updating may include obtaining a value of a probability update indicator for a portion of the decoded image data, the value of the probability update indicator for the portion indicating whether per-symbol entropy coding probability updating is disabled for the portion, and generating decoded image data for the portion in accordance with the value of the probability update indicator for the portion.

公开(公告)号：US10798408B2

公开(公告)日：2020-10-06

申请号：US16407297

申请日：2019-05-09

Applicant: GOOGLE LLC

Inventor： James Bankoski ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/52 ,  H04N19/105 ,  H04N19/176 ,  H04N19/119 ,  H04N19/513 ,  H04N19/136 ,  H04N19/167 ,  H04N19/44

Abstract: A first partitioning for partitioning a first region of a frame before a current frame in a video sequence is determined. The first partitioning defines at least two prediction sub-regions of the first region, and the prediction sub-regions include contiguous, non-overlapping groups of pixels. A motion vector that predicts a prediction sub-region of the first region is determined. The first partitioning is modified to a second partitioning by moving at least one border of the first partitioning that is between adjacent prediction sub-regions of the first region by the motion vector. A current region of the current frame that is collocated with the first region is partitioned by the second partitioning, and is encoded or decoded. The technique eliminates the need to re-partition an entire frame each time, and can be used with both rectangular-shaped block partitioning and partitioning using masks and other partitioning techniques.