公开(公告)号：US20250039436A1

公开(公告)日：2025-01-30

申请号：US18785699

申请日：2024-07-26

Applicant: GOOGLE LLC

Inventor： Lester Lu ,  Xiang Li ,  Debargha Mukherjee

IPC: H04N19/513 ,  H04N19/139 ,  H04N19/176 ,  H04N19/196

Abstract: Coding including dynamic range handling of high dimensional inverse autocorrelation in optical flow refinement includes obtaining a refinement model from available warped refinement models, wherein the available warped refinement models include a four-parameter scaling refinement model, a three-parameter scaling refinement model, and a four-parameter rotational refinement model, obtaining refined motion vectors using the warped refinement model and previously obtained reference frame data in the absence of data expressly indicating the refined motion vectors in the encoded bitstream, wherein obtaining the refined motion vectors includes using a dynamic range adjusted autocorrelation matrix, generating refined prediction block data using the refined motion vectors, generating reconstructed block data using the refined prediction block data, including the reconstructed block data in reconstructed frame data for the current frame, and outputting the reconstructed frame data.

公开(公告)号：US20240380924A1

公开(公告)日：2024-11-14

申请号：US18635323

申请日：2024-04-15

Applicant: GOOGLE LLC

Inventor： Bohan Li ,  Debargha Mukherjee ,  Yaowu Xu ,  Jingning Han

IPC: H04N19/60 ,  H04N19/159 ,  H04N19/176 ,  H04N19/70

Abstract: Decoding a current block of a current frame includes decoding, from a compressed bitstream, one or more syntax elements indicating that a geometric transformation is to be applied; applying the geometric transformation to at least a portion of the current frame to obtain a transformed portion; and obtaining a prediction of the current block based on the transformed portion and an intra-prediction mode.

公开(公告)号：US20240323361A1

公开(公告)日：2024-09-26

申请号：US18678031

申请日：2024-05-30

Applicant: GOOGLE LLC

Inventor： Lester Lu ,  Debargha Mukherjee ,  Elliott Karpilovsky

IPC: H04N19/107 ,  H04N19/122 ,  H04N19/176 ,  H04N19/50

CPC classification number: H04N19/107 ,  H04N19/122 ,  H04N19/176 ,  H04N19/50

Abstract: Decoding video data includes, for a block encoded using a prediction mode, determining a transform mode for the block using the prediction mode. The transform mode is a first mode when the prediction mode is an inter-prediction mode and is a second mode when the prediction mode is an intra-prediction mode. The first mode is an available first transform type that is a combination of transforms selected from first fixed transforms and first learned transforms that each comprise a respective transformation matrix generated iteratively using blocks predicted using the inter-prediction mode. The second mode is an available second transform type that is a combination of transforms selected from second fixed transforms, which is a proper subset of the first fixed transforms, and a second learned transform comprising a transformation matrix that is generated iteratively using blocks predicted using the intra-prediction mode. Decoding the block uses the prediction and transform modes.

公开(公告)号：US20240205458A1

公开(公告)日：2024-06-20

申请号：US18542850

申请日：2023-12-18

Applicant: GOOGLE LLC

Inventor： Onur Guleryuz ,  Zeyu Deng ,  Debargha Mukherjee ,  Lester Lu ,  Yue Chen

IPC: H04N19/61 ,  H04N19/105 ,  H04N19/12 ,  H04N19/124 ,  H04N19/13 ,  H04N19/172 ,  H04N19/176 ,  H04N19/42

CPC classification number: H04N19/61 ,  H04N19/105 ,  H04N19/12 ,  H04N19/124 ,  H04N19/13 ,  H04N19/172 ,  H04N19/176 ,  H04N19/42 ,  H04N19/70

Abstract: Transform prediction with parsing independent coding includes generating a reconstructed frame and outputting the reconstructed frame. Generating the reconstructed frame includes entropy decoding transform blocks for the reconstructed frame, entropy decoding decoded transform identifiers for the transform blocks, obtaining transform-specific probability distributions for available transforms, and, for a current transform block from the transform blocks, identifying a current remapped transform identifier from the decoded transform identifiers, identifying a current transform identifier in accordance with the current remapped transform identifier, the transform coefficients from the current transform block, and the transform-specific probability distributions, identifying a current transform in accordance with the current transform identifier; inverse transforming, in accordance with the current transform, the current transform block to obtain a current residual block and obtaining a current reconstructed block using the current residual block. Generating the reconstructed frame includes including the current reconstructed block in the reconstructed frame.

公开(公告)号：US11924476B2

公开(公告)日：2024-03-05

申请号：US17866631

申请日：2022-07-18

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee

IPC: H04N19/86 ,  H04N19/182 ,  H04N19/46 ,  H04N19/80 ,  H04N19/174 ,  H04N19/85 ,  H04N19/192 ,  G06T5/00 ,  H04N19/117 ,  H04N19/136 ,  H04N19/176 ,  H04N19/463

CPC classification number: H04N19/865 ,  G06T5/002 ,  H04N19/117 ,  H04N19/136 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182 ,  H04N19/192 ,  H04N19/46 ,  H04N19/80 ,  H04N19/85 ,  H04N19/86 ,  G06T2207/20021 ,  G06T2207/20192 ,  H04N19/463

Abstract: A device for restoring a degraded frame resulting from reconstruction of a source frame includes a processor that is configured to receive a compressed bitstream. The compressed bitstream includes a first projection parameter α a second projection parameter β, first restoration parameters comprising a first radius value, and second restoration parameters comprising a second radius value. The processor is further configured to restore at least a portion of the degraded frame using a projection operation that uses the first projection parameter α, the second projection parameter β, and at least two guide tiles.

公开(公告)号：US20230199179A1

公开(公告)日：2023-06-22

申请号：US18173286

申请日：2023-02-23

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Urvang Joshi ,  Yue Chen ,  Sarah Parker

IPC: H04N19/107 ,  H04N19/105 ,  H04N19/154 ,  H04N19/184 ,  G06N20/00 ,  G06N3/08 ,  G06N3/045

CPC classification number: H04N19/107 ,  G06N3/08 ,  G06N3/045 ,  G06N20/00 ,  H04N19/105 ,  H04N19/154 ,  H04N19/184

Abstract: Video coding may include generating, by a processor, a decoded frame by decoding a current frame from an encoded bitstream and outputting a reconstructed frame based on the decoded frame. Decoding includes identifying a current encoded block from the current frame, identifying a prediction coding model for the current block, wherein the prediction coding model is a machine learning prediction coding model from a plurality of machine learning prediction coding models, identifying reference values for decoding the current block based on the prediction coding model, obtaining prediction values based on the prediction coding model and the reference values, generating a decoded block corresponding to the current encoded block based on the prediction values, and including the decoded block in the decoded frame.

公开(公告)号：US11601644B2

公开(公告)日：2023-03-07

申请号：US16295176

申请日：2019-03-07

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Urvang Joshi ,  Yue Chen ,  Sarah Parker

IPC: H04N19/107 ,  H04N19/105 ,  H04N19/154 ,  H04N19/184 ,  G06N20/00 ,  G06N3/04 ,  G06N3/08

Abstract: Video coding may include generating, by a processor, a decoded frame by decoding a current frame from an encoded bitstream and outputting a reconstructed frame based on the decoded frame. Decoding includes identifying a current encoded block from the current frame, identifying a prediction coding model for the current block, wherein the prediction coding model is a machine learning prediction coding model from a plurality of machine learning prediction coding models, identifying reference values for decoding the current block based on the prediction coding model, obtaining prediction values based on the prediction coding model and the reference values, generating a decoded block corresponding to the current encoded block based on the prediction values, and including the decoded block in the decoded frame.

公开(公告)号：US20230050660A1

公开(公告)日：2023-02-16

申请号：US17793620

申请日：2020-05-14

Applicant: GOOGLE LLC

Inventor： James Bankoski ,  Debargha Mukherjee

IPC: H04N19/593 ,  H04N19/196 ,  H04N19/167 ,  H04N19/105 ,  H04N19/176 ,  H04N19/59 ,  H04N19/159

Abstract: A method for intra-prediction of a current block includes selecting peripheral pixels of the current block, where the peripheral pixels are used to generate a prediction block for the current block; for each prediction pixel of the prediction block, performing steps including selecting two respective pixels of the peripheral pixels; and calculating the prediction pixel by interpolating at least the two respective pixels; and coding a residual block corresponding to a difference between the current block and the prediction block.

公开(公告)号：US20220256186A1

公开(公告)日：2022-08-11

申请号：US17731470

申请日：2022-04-28

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  James Bankoski ,  Yue Chen ,  Yuxin Liu ,  Sarah Parker

IPC: H04N19/517 ,  H04N19/46 ,  H04N19/136 ,  H04N19/105 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182

Abstract: Generating a compound predictor block for a current block of video includes generating, for the current block, a first predictor block using one of inter-prediction or intra-prediction and generating a second predictor block. The first predictor block includes a first pixel and the second predictor block includes a second pixel that is co-located with the first pixel. A first weight is determined for the first pixel using a difference between a value of the first pixel and a value of the second pixel. A second weight is determined for the second pixel using the first weight. The compound predictor block is generated by combining the first predictor block and the second predictor block. The compound predictor block includes a weighted pixel that is determined using a weighted sum of the first pixel and the second pixel using the first weight and the second weight.

公开(公告)号：US20220207654A1

公开(公告)日：2022-06-30

申请号：US17698116

申请日：2022-03-18

Applicant: GOOGLE LLC

Inventor： Debargha Mukherjee ,  Urvang Joshi ,  Yue Chen ,  Sarah Parker

IPC: G06T5/00 ,  G06T5/50 ,  G06N3/08 ,  G06N3/04 ,  G06N20/20 ,  G06T3/40 ,  H04N19/70 ,  H04N19/176 ,  G06K9/62 ,  G06T9/00

Abstract: Guided restoration is used to restore video data degraded from a video frame. The video frame is divided into restoration units (RUs) which each correspond to one or more blocks of the video frame. Restoration schemes are selected for each RU. The restoration schemes may indicate to use one of a plurality of neural networks trained for the guided restoration. Alternatively, the restoration schemes may indicate to use a neural network and a filter-based restoration tool. The video frame is then restored by processing each RU according to the respective selected restoration scheme. During encoding, the restored video frame is encoded to an output bitstream, and the use of the selected restoration schemes may be signaled within the output bitstream. During decoding, the restored video frame is output to an output video stream.