An image restoration device, an image restoration method, and an image restoration system are provided. The image restoration device includes a point spread function estimation unit, and an image restoration filter unit. The point spread function estimation unit receives an image signal and estimates a Point Spread Function (PSF) from the received image signal. The image restoration filter unit receives the image signal and the PSF, generates an image restoration filter coefficient from the PSF, and filters the image signal according to the image restoration filter coefficient to output the filtered image signal.