In a three-dimensional shape extraction apparatus, a distance distribution extraction unit (54) obtains the distance distribution of an object on the basis of a plurality of images which are sensed by a camera at different image sensing positions, so that the images of the object partially overlap each other, and the position information of the respective image sensing positions of the camera. A three-dimensional model forming unit (55) forms a three-dimensional model of the object by sequentially combining the sequentially calculated distance distributions and the sensed images using the position information. A 3D display image generation unit (56) generates and displays a two-dimensional image from the three-dimensional model.