Disclosed is an image restoring apparatus and a method thereof, which sets a restoration image area to establish a portion of a target image area to be restored as a restoration image area to be restored with priority according to a request for an image restoration; sets a search area to establish an area with a predetermined size including the restoration image area as a search area; detects a similar image area to search for the most similar image area to the restoration image area within the search area; and reconstructs the deteriorated image in a natural manner by copying the image of the detected similar image area and attaching the same to the restoration image area.