In an image processing apparatus which performs registration between a referring image and a moving image, the image processing apparatus sets a control grid on the moving image in order to deform the moving image. The image processing apparatus extracts feature points from the moving image and the referring image, respectively. The apparatus searches positions corresponding to the extracted feature points from the referring image and the moving image. The apparatus sets the initial positions of control points on the control grid set on the moving image by using the searched-out positions. The extracted feature points correspond to each other on the referring image and the moving image, respectively, and are feature portions on the respective images.