JOINT FORWARD AND BACKWARD NEURAL NETWORK OPTIMIZATION IN IMAGE PROCESSING

    公开(公告)号:US20230084705A1

    公开(公告)日:2023-03-16

    申请号:US17800886

    申请日:2021-02-17

    Inventor: Guan-Ming SU

    Abstract: A source color grade and a destination color grade may be received by an end-to-end image mapping pipeline comprising forward and backward paths. Forward neural networks in the forward path may be applied to generate, from the source color grade, a forward reshaped color grade corresponding to the destination color grade. Backward neural networks in the backward path may be applied to generate, from the forward reshaped color grade, a backward reshaped color grade corresponding to the source color grade. An overall neural network cost function may be specified for the forward path and the backward path to generate a cost that may be used as a basis for determining operational parameters for the forward and backward neural networks.

    CASCADE PREDICTION
    44.
    发明申请

    公开(公告)号:US20230007294A1

    公开(公告)日:2023-01-05

    申请号:US17781165

    申请日:2020-12-03

    Abstract: A first predictor is applied to an input image to generate first-stage predicted codewords approximating prediction target codewords of a prediction target image. Second-stage prediction target values are created by performing an inverse cascade operation on the prediction target codewords and the first-stage predicted codewords. A second predictor is applied to the input image to generate second-stage predicted values approximating the second-stage prediction target values. Multiple sets of cascade prediction coefficients are generated to comprise first and second sets of cascade prediction coefficients specifying the first and second predictors. The multiple sets of cascade prediction coefficients are encoded, in a video signal, as image metadata. The video signal is further encoded with the input image.

    EFFICIENT USER-DEFINED SDR-TO-HDR CONVERSION WITH MODEL TEMPLATES

    公开(公告)号:US20220301124A1

    公开(公告)日:2022-09-22

    申请号:US17635684

    申请日:2020-08-12

    Abstract: Backward reshaping metadata prediction models are trained with training SDR images and corresponding training HDR images. Content creation user input to define user adjusted HDR appearances for the corresponding training HDR images is received. Content-creation-user-specific modified backward reshaping metadata prediction models are generated based on the trained prediction models and the content creation user input. The content-creation-user-specific modified prediction models are used to predict operational parameter values of content-creation-user-specific backward reshaping mappings for backward reshaping SDR images into mapped HDR images of at least one content-creation-user-adjusted HDR appearance.

    REDUCING BANDING ARTIFACTS IN BACKWARD-COMPATIBLE HDR IMAGING

    公开(公告)号:US20210368212A1

    公开(公告)日:2021-11-25

    申请号:US17282523

    申请日:2019-10-02

    Abstract: Methods and systems for reducing banding artifacts when displaying high-dynamic-range images reconstructed from coded reshaped images are described. Given an input image in a high dyna mic range (HDR) which is mapped to a second image in a second dynamic range, banding artifacts in a reconstructed HDR image generated using the second image are reduced by a) in darks and mid-tone regions of the input image, adding noise to the input image before being mapped to the second image, and b) in highlights regions of the input image, modifying an input backward reshaping function, wherein the modified backward reshaping function will be used by a decoder to map a decoded version of the second image to the reconstructed HDR image. An example noise generation technique using simulated film-grain noise is provided.

    COLOR APPEARANCE PRESERVATION IN VIDEO CODECS

    公开(公告)号:US20200351524A1

    公开(公告)日:2020-11-05

    申请号:US16863022

    申请日:2020-04-30

    Abstract: A standard dynamic range (SDR) image and a reference backward reshaping mapping are received. The reference backward reshaping mapping comprises a reference luma backward reshaping mapping. A color preservation mapping function is used with inputs generated from the SDR image and the reference backward reshaping mapping to determine luminance increase for SDR luma histogram bins generated based on luma codewords in the SDR image. A modified backward reshaping mapping is generated and comprises a modified luma backward reshaping mapping generated from the reference backward reshaping function based on the luminance increase for the SDR luma histogram bins. The SDR image and the modified backward reshaping mapping are encoded into an SDR video signal.

    REAL-TIME RESHAPING OF SINGLE-LAYER BACKWARDS-COMPATIBLE CODEC

    公开(公告)号:US20190222866A1

    公开(公告)日:2019-07-18

    申请号:US16329392

    申请日:2017-08-28

    Abstract: Real-time forward reshaping, comprising selecting a statistical sliding window that indexes with the current frame, having also, a look-back frame and a look-ahead frame, determining whether they are part of the current scene, determining a noise parameter, a luma transfer function and a luma forward reshaping function based on the luma transfer function and the noise parameter within the current scene, selecting a central tendency sliding window of the current frame and the look-back frame within the current scene, and determining a central tendency luma forward reshaping function. The chroma reshaping comprises analyzing statistics for the extended dynamic range (EDR) weights and EDR upper bounds, mapping these to standard dynamic range (SDR) weights and SDR upper bounds based on the central tendency luma forward reshaping function, determining a chroma content-dependent polynomial and a central tendency chroma forward reshaping polynomial and generating chroma MMR coefficients.

    ENHANCEMENT LAYER MASKING FOR HIGH-DYNAMIC RANGE VIDEO CODING

    公开(公告)号:US20190141337A1

    公开(公告)日:2019-05-09

    申请号:US16095338

    申请日:2017-04-18

    Abstract: A method to improve the efficiency of coding high-dynamic range (HDR) signals in a dual-layer system is presented. A piece-wise linear, two-segment, inter-layer predictor is designed where base-layer codewords larger than a highlights threshold (Sh) are all mapped to a constant value. Given a target bit rate for the enhancement layer, which can be expressed as a percentage (β) of the bit rate of the base layer, an optimal highlights threshold is derived by computing estimated bit rates for the base and enhancement layers based on pixel complexity measures of pixels in the input HDR signal and the threshold value, and by minimizing an optimization criterion.

Patent Agency Ranking