An image registration apparatus (118) includes an image quality driven image registration determiner (202) that determines an image quality driven image registration for a set of images to register based on a non-rigid registration (204), which includes an optimization of an image similarity term and a regularization term, and a registration steering factor, and a registration component (206) that registers the set of images using the image quality driven image registration. A method determining an image quality driven image registration for a set of images to register based on a non-rigid registration, which includes an optimization of an image similarity term and a regularization term, and a registration steering factor, and registering the set of images using the fidelity driven image registration, generating a set of registered images.