An electronic apparatus and a method for controlling thereof are provided. The method includes acquiring a first Light field (LF) image of different viewpoints, inputting the first LF image to a first artificial intelligence model to acquire a pixel shift value for converting pixels in the first LF image, converting the pixels in the first LF image according to the pixel shift value to acquire a second LF image, inputting the first LF image and the second LF image to a second artificial intelligence model for converting the LF image to a layer image to acquire the layer image, inputting the acquired layer image to a simulation model for restoring the LF image to acquire a third LF image, and learning the first artificial intelligence model and the second artificial intelligence model based on the second LF image and the third LF image.