GUIDED RESTORATION OF VIDEO DATA USING NEURAL NETWORKS

    公开(公告)号:US20220207654A1

    公开(公告)日:2022-06-30

    申请号:US17698116

    申请日:2022-03-18

    Applicant: GOOGLE LLC

    Abstract: Guided restoration is used to restore video data degraded from a video frame. The video frame is divided into restoration units (RUs) which each correspond to one or more blocks of the video frame. Restoration schemes are selected for each RU. The restoration schemes may indicate to use one of a plurality of neural networks trained for the guided restoration. Alternatively, the restoration schemes may indicate to use a neural network and a filter-based restoration tool. The video frame is then restored by processing each RU according to the respective selected restoration scheme. During encoding, the restored video frame is encoded to an output bitstream, and the use of the selected restoration schemes may be signaled within the output bitstream. During decoding, the restored video frame is output to an output video stream.

    Inter-prediction mode-dependent transforms for video coding

    公开(公告)号:US11197004B1

    公开(公告)日:2021-12-07

    申请号:US16919507

    申请日:2020-07-02

    Applicant: Google LLC

    Abstract: Transform modes are derived for inter-predicted blocks using side information available within a bitstream. An inter-predicted encoded video block and side information are identified within a bitstream. Based on the side information, a trained transform is determined for inverse transforming transform coefficients of the inter-predicted encoded video block from amongst multiple trained transforms. The transform coefficients of the inter-predicted encoded video block are inverse transformed according to the trained transform to produce a prediction residual. A video block is reconstructed using the prediction residual and the reference frame. The video block is then output within an output video stream for storage or display. To determine the trained transforms, a learning model uses individual side information types and combinations of the individual side information types processed against a training data set.

    RESTORATION IN VIDEO CODING USING FILTERING AND SUBSPACE PROJECTION

    公开(公告)号:US20200068224A1

    公开(公告)日:2020-02-27

    申请号:US16666676

    申请日:2019-10-29

    Applicant: GOOGLE LLC

    Abstract: A method includes generating, using first restoration parameters, a first guide tile for a degraded tile of the degraded frame, the degraded tile corresponding to a source tile of the source frame; generating, using second restoration parameters, a second guide tile for the degraded tile of the degraded frame, the second restoration parameters being different from the first restoration parameters; determining a first tile difference between the source tile and the first guide tile; determining a second tile difference between the source tile and the second guide tile; calculating projection parameters that minimize a difference between a restored tile of the degraded tile and the source tile; and encoding, in an encoded bitstream, the projection parameters. The difference between the restored tile of the degraded tile and the source tile is a linear combination, using the projection parameters, of the first tile difference and the second tile difference.

    SEGMENTATION-BASED PARAMETERIZED MOTION MODELS

    公开(公告)号:US20180270497A1

    公开(公告)日:2018-09-20

    申请号:US15838748

    申请日:2017-12-12

    Applicant: GOOGLE LLC

    Abstract: Encoding and decoding using parametrized motion models are disclosed. A method includes segmenting the video frame with respect to a reference frame resulting in a segmentation, determining a first motion vector for the current block based on the segmentation, determining a second motion vector for the current block using translational motion compensation, and encoding, for the current block, the one of the first motion vector and the second motion vector corresponding to a smaller error. The segmentation includes a segment containing the current block and a parameterized motion model for the segment. Another method includes identifying a parameterized motion model corresponding to a motion model type, associating the parameterized motion model with a segment of a reference frame, and, in response to determining that the current block is encoded using the parameterized motion model, decoding the current block using the parameterized motion model.

Patent Agency Ranking