Provided is a method and apparatus for restoring an image, the apparatus including a plurality of lenses configured to pass a plurality of rays, a sensor including a target sensing element configured to receive a target ray passing a first lens among the plurality of lenses, and a second sensing element configured to receive a second ray passing a second lens among the plurality of lenses, the first lens being different from the second lens, and a processor configured to determine the second sensing element based on a difference between a direction of the target ray and a direction of the second ray, and to restore color information corresponding to the target sensing element based on color information detected by the second sensing element.