An arbitrary viewpoint image generation method includes obtaining an original image set photographed by a plurality of cameras included in a camera array at each of at least one focal distance at a same time point; obtaining a multi-focus image set by generating a multi-focus image from the original image set for each of the at least one focal distance; and generating an arbitrary viewpoint image at a position where a viewpoint is to be moved from the multi-focus image set.