An endoscope spectral image system is provided and includes: an image recording apparatus for recording a color image provided by using a scope; and a processor apparatus, in which spectroscopic characteristic information including a spectroscopic characteristic of CCD is output from the processor apparatus to the image recording apparatus along with color image data. At the image recording apparatus, matrix data in correspondence with the spectroscopic characteristic information is selected to be read from a plurality of matrix data stored in a memory, matrix operation by the matrix data and color image data is carried out at a spectral image-forming circuit, and a spectral image formed by signals of arbitrarily selected wavelength regions is provided.