Systems and methods are described that validate color information in metadata associated with an image. Color information associated with images, in metadata, may need to be validated because there may be mistakes in the metadata. Color names associated with colors may be based on human generated data or human surveys. Individual colors may be extracted from images, which may be associated with the color names. Furthermore, the color names may be retrieved from a data store via a fast index color search. The color information in the metadata may be validated against the color names.