Techniques of compressing color images in the presence of chromatic aberrations involve performing, prior to compression, a chromatic aberration correction operation on a color image. Along these lines, the chromatic aberration of an imaging system may be represented as a vector displacement map between a red channel and a green channel of a color image, a blue channel and a green channel of the color image, or both. In some implementations, prior to adding the vector displacements to each of the images of the red channel and the blue channel, these displacements are weighted according to proximity from an edge of each of the respective red and blue images. In some further implementations, the vector displacement maps as well as the weights are blurred with a blurring kernel such as a gaussian. Once these vector displacements are added to each of the red and blue images, the resulting color images are linearly combined to produce a new brightness channel Y. This new brightness channel Y is compressed to form the compressed color image.