An image recovery apparatus and method are provided, where the image recovery apparatus calculates a reference color image based on a linear correlation between a color channel image and a luminance channel image, and corrects the luminance channel image based on residual information that indicates a difference between the reference color image and the color channel image, to recover an image.