A non-uniform super-resolution method, device, and recording medium of an image of the present disclosure may include an image separation unit which separates an input image into a high-quality region and a low-quality region based on a quality map image, an image quality conversion unit which acquires a converted high-quality region by converting image quality of the high-quality region, and a first image combination unit which combines the converted high-quality region and the low-quality region to transmit them to a super-resolution network.