A method and apparatus for reproducing a shape and a pattern in a three-dimensional scene with good precision, based on a plurality of images, by realizing processing that considers a three-dimensional model from the beginning of the processing. A plurality of images are captured, a plurality of frames to which processing is applied are selected from the captured images, correspondence between a plurality of images are extracted, a three-dimensional model to be a base is input, a three-dimensional model that defines geometric properties in a target object in the images is selected, correspondence between the images and the three-dimensional model is specified, the three-dimensional model is deformed while satisfying both the correspondence between the images and the correspondence between the images and the three-dimensional model, a pattern image to be attached to a surface is generated based on a shape of the three-dimensional model and the correspondence between the three-dimensional model and the images, and the final three-dimensional model is output.