Techniques related to video processing with adaptive sharpness enhancement are discussed. Such techniques may include determining a detail versus noise score for a video frame based on a noise level, a motion level, an average luma value, and spatial frequency information of the video frame and enhancing sharpness of the video frame based on sharpness enhancement control parameters generated based on the detail versus noise score for the video frame.