The invention relates to a system (100) for registering a vessel model with an image data set based on a joined model comprising a reference object model and the vessel model, the system comprising: a placement unit (110) for placing the joined model in a space of the image data set, thereby creating a placed joined model comprising a placed reference object model and a placed vessel model; a computation unit (120) for computing a deformation field based on a landmark displacement field comprising displacements of landmarks of the placed reference object model relative to corresponding landmarks in the image data set; a transformation unit (130) for transforming the placed joined model using the deformation field, thereby creating a transformed joined model comprising a transformed reference object model and a transformed vessel model; and a registration unit (140) for registering the transformed vessel model with the image data set based on modifying the transformed vessel model and optimizing an objective function of the modified transformed vessel model, wherein the objective function comprises a location-prior term based on a localization of the modified transformed vessel model relative to the transformed joined model. Hence, the system is arranged to model a vessel taking into account the localization of a vessel model relative to a reference anatomical structure described by a reference model.