Enabling adjustment of sharpness and details of an input image in upscaling, including: applying a Fourier transform function on a brightness channel of the input image to generate a 2-D frequency map; adjusting the 2-D frequency map to control a target amount of sharpness and details in an upscaled output image; and using the adjusted 2-D frequency map as an additional input channel along with standard color image data for a training and upscaling process.