Peteye is the appearance of an unnatural coloration (not necessarily red) of the pupils in an animal appearing in an image captured by a camera with flash illumination. Systems and methods of detecting and correcting peteye are described. In one aspect a classification map segmenting pixels in the input image into peteye pixels and non-peteye pixels is generated based on a respective segmentation condition on values of the pixels. Candidate peteye pixel areas are identified in the classification map. The generating and the identifying processes are repeated with the respective condition replaced by a different respective segmentation condition on the pixel values.