Color management using a vector-based color difference metric. A color difference map is comprised of color difference vectors for each of a plurality of pixels of an original image. The color difference vector for each pixel includes both a magnitude and a directionality representing a difference for color data in each pixel in the original image, relative to color data in a corresponding mapped pixel in a color mapped image. Pixels in the color difference map having large color differences in color movement relative to nearby pixels are identified in the color difference map, by applying an edge-detection algorithm to the color difference map. For each pixel that is identified in a smooth area in the original image and is identified as having a large color difference in the color difference map, a correction algorithm is applied, so as to provide a corrected color mapped image.