Image and video coding using machine learning prediction coding models

    公开(公告)号:US11601644B2

    公开(公告)日:2023-03-07

    申请号:US16295176

    申请日:2019-03-07

    Applicant: GOOGLE LLC

    Abstract: Video coding may include generating, by a processor, a decoded frame by decoding a current frame from an encoded bitstream and outputting a reconstructed frame based on the decoded frame. Decoding includes identifying a current encoded block from the current frame, identifying a prediction coding model for the current block, wherein the prediction coding model is a machine learning prediction coding model from a plurality of machine learning prediction coding models, identifying reference values for decoding the current block based on the prediction coding model, obtaining prediction values based on the prediction coding model and the reference values, generating a decoded block corresponding to the current encoded block based on the prediction values, and including the decoded block in the decoded frame.

    COMPOUND PREDICTION FOR VIDEO CODING

    公开(公告)号:US20220256186A1

    公开(公告)日:2022-08-11

    申请号:US17731470

    申请日:2022-04-28

    Applicant: GOOGLE LLC

    Abstract: Generating a compound predictor block for a current block of video includes generating, for the current block, a first predictor block using one of inter-prediction or intra-prediction and generating a second predictor block. The first predictor block includes a first pixel and the second predictor block includes a second pixel that is co-located with the first pixel. A first weight is determined for the first pixel using a difference between a value of the first pixel and a value of the second pixel. A second weight is determined for the second pixel using the first weight. The compound predictor block is generated by combining the first predictor block and the second predictor block. The compound predictor block includes a weighted pixel that is determined using a weighted sum of the first pixel and the second pixel using the first weight and the second weight.

    GUIDED RESTORATION OF VIDEO DATA USING NEURAL NETWORKS

    公开(公告)号:US20220207654A1

    公开(公告)日:2022-06-30

    申请号:US17698116

    申请日:2022-03-18

    Applicant: GOOGLE LLC

    Abstract: Guided restoration is used to restore video data degraded from a video frame. The video frame is divided into restoration units (RUs) which each correspond to one or more blocks of the video frame. Restoration schemes are selected for each RU. The restoration schemes may indicate to use one of a plurality of neural networks trained for the guided restoration. Alternatively, the restoration schemes may indicate to use a neural network and a filter-based restoration tool. The video frame is then restored by processing each RU according to the respective selected restoration scheme. During encoding, the restored video frame is encoded to an output bitstream, and the use of the selected restoration schemes may be signaled within the output bitstream. During decoding, the restored video frame is output to an output video stream.

    SEGMENTATION-BASED PARAMETERIZED MOTION MODELS

    公开(公告)号:US20180270497A1

    公开(公告)日:2018-09-20

    申请号:US15838748

    申请日:2017-12-12

    Applicant: GOOGLE LLC

    Abstract: Encoding and decoding using parametrized motion models are disclosed. A method includes segmenting the video frame with respect to a reference frame resulting in a segmentation, determining a first motion vector for the current block based on the segmentation, determining a second motion vector for the current block using translational motion compensation, and encoding, for the current block, the one of the first motion vector and the second motion vector corresponding to a smaller error. The segmentation includes a segment containing the current block and a parameterized motion model for the segment. Another method includes identifying a parameterized motion model corresponding to a motion model type, associating the parameterized motion model with a segment of a reference frame, and, in response to determining that the current block is encoded using the parameterized motion model, decoding the current block using the parameterized motion model.

Patent Agency Ranking