The color measurement device and an image forming apparatus using the same includes a light source for irradiating a color measurement object with white light; a diffraction grating for dispersing the light reflected from the color measurement object; and a line sensor formed of multiple pixels that generate an electric signal corresponding to the intensity of the light dispersed by the diffraction grating, wherein the light source includes a light-emitting diode having a peak value of emission intensity in a wavelength zone of 380 nm to 420 nm, and a plural types of fluorescent members each having a peak value of fluorescence intensity in a wavelength zone of 420 nm to 730 nm.