A method for adjusting pixel colors between image frames includes scanning, at a processor, a first image frame of a sequence of image frames. The method also includes determining a grayscale threshold based on characteristics of the first image frame to identify gray pixel candidates in the first image frame. The method further includes adjusting a pixel value of each pixel in the first image frame based on a chromatic adaptation transform estimation. The chromatic adaptation transform estimation is based on the gray pixel candidates. The grayscale threshold may be computed for each image frame in the sequence of image frames.