APPARATUS AND METHOD FOR IMAGE PROCESSING, AND SYSTEM FOR TRAINING NEURAL NETWORK

    公开(公告)号:US20210334642A1

    公开(公告)日:2021-10-28

    申请号:US16604410

    申请日:2019-04-23

    Abstract: The present disclosure generally relates to the field of deep learning technologies. An apparatus for generating a plurality of correlation images may include a feature extracting unit configured to receive a training image and extracting at least one or more of feature from the training image to generate a first feature image based on the training image; a normalizer configured to normalize the first feature image and generate a second feature image; and a shift correlating unit configured to perform a plurality of translational shifts on the second feature image to generate a plurality of shifted images, correlate each of the plurality of shifted images with the second feature image to generate the plurality of correlation images.

    IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD THEREOF, IMAGE PROCESSING SYSTEM, AND TRAINING METHOD THEREOF

    公开(公告)号:US20210097645A1

    公开(公告)日:2021-04-01

    申请号:US16465294

    申请日:2018-12-17

    Abstract: The present disclosure relates to an image processing method. The image processing method may include upscaling a feature image of an input image by an upscaling convolutional network to obtain a upscaled feature image; downscaling the upscaled feature image by a downscaling convolutional network to obtain a downscaled feature image; determining a residual image between the downscaled feature image and the feature image of the input image; upscaling the residual image between the downscaled feature image and the feature image of the input image to obtain an upscaled residual image; correcting the upscaled feature image using the upscaled residual image to obtain a corrected upscaled feature image; and generating a first super-resolution image based on the input image using the corrected upscaled feature image.

    Video resolution enhancement method, storage medium, and electronic device

    公开(公告)号:US12236556B2

    公开(公告)日:2025-02-25

    申请号:US17762199

    申请日:2021-04-19

    Inventor: Lijie Zhang Dan Zhu

    Abstract: Provided are a method for enhancing a video resolution enhancement, a computer readable storage medium, and an electronic device. The method includes: obtaining multiple image frames as input data, and obtaining initial data by performing feature extraction on the input data using a first three-dimensional convolutional layer; obtaining first feature data by performing down-sampling on the initial data at a preset multiple; obtaining first reference data by performing a convolution operation on the first feature data using a second three-dimensional convolutional layer to merge the first feature data as one frame; and obtaining first output data by performing up-sampling on the first reference data at the preset multiple.

    Computer-implemented method, apparatus, and computer-program product

    公开(公告)号:US12198226B2

    公开(公告)日:2025-01-14

    申请号:US17907012

    申请日:2021-12-28

    Abstract: A computer-implemented method is provided. The computer-implemented method includes inputting a low-resolution image and a plurality of high-resolution images into a feature extractor, the low-resolution image and the plurality of high-resolution images including images of a target object; obtaining, by the feature extractor, feature maps of the low-resolution image and the plurality of high-resolution images; comparing similarities between the feature maps of the low-resolution image and the plurality of high-resolution images; obtaining selected feature maps of one or more selected high-resolution images of the plurality of high-resolution images most similar to the low-resolution image; inputting the selected feature maps into a generator to output a repair image; enhancing the low-resolution image using a pre-processing image enhancing process to generate an enhanced image; and morphing the repair image with the enhanced image.

    Video enhancement method and apparatus, and electronic device and storage medium

    公开(公告)号:US12190472B2

    公开(公告)日:2025-01-07

    申请号:US17630784

    申请日:2021-03-10

    Abstract: A video enhancement method and apparatus, an electronic device, and a storage medium are described. The method comprises: extracting features from M frames of images, so as to obtain at least one first-scale image feature (S310); for each first-scale image feature, performing N-level down-sampling processing on the first-scale image feature, so as to obtain a second-scale image feature (S320); performing N-level up-sampling processing on the second-scale image feature, so as to obtain a third-scale image feature (S330), wherein the input of ith-level up-sampling processing is an image feature obtained after performing superimposition processing on the output of (N+1−i)th-level down-sampling processing and the output of (i−1)th-level up-sampling processing, and the multiple of jth-level up-sampling is the same as the multiple of (N+1−j)th-level down-sampling; and performing superimposition processing on the third-scale image feature and the first-scale image feature.

Patent Agency Ranking