A method and an apparatus for recovering a component of a distortion field of an image of a set of multi-view images are described. Also described are a method and an apparatus for determining a disparity field of an image of a set of multi-view images, which makes use of such method.In a first step pixel correspondences between the image and another image of the set of multi-view images are determined. A disparity field is then determined from at least a subset of the determined pixel correspondences. The disparity field is smoothed and the component of the distortion field is estimated from the smoothed disparity field. When determining a second disparity field the estimated component of the distortion field is taken into account when determining pixel correspondences between the image and another image of the set of multi-view images.