A multi-color image processor according to the present invention includes an image capturing section 101 and a signal processing section 104. The image capturing section 101 includes a color separating section 10 for separating visible radiation into at least two light rays with first- and second-color components, respectively, and first and second imagers 12 and 14 that receive the light rays with the first- and second-color components. The image capturing section 101 gets images with the first- and second-color components by making the first imager 12 decimate pixels to read, but making the second imager 14 read every pixel, on a field-by-field basis on respective arrangements of pixels of the first and second imagers 12 and 14. The signal processing section 104 includes: a motion estimating section 107 for estimating, based on the images with the second-color components, a motion in a moving picture made up of images with the second-color components and outputting motion information; an image generating section 108 for generating a synthetic image of the first-color components of respective fields based on the images with the first-color components and the motion information and outputting it as a first synthetic image with a higher spatial resolution than the images with the first-color components; and a multi-color image synthesizing section 109 for generating and outputting a multi-color moving picture with the first- and second-color components based on the first synthetic image and the images with the second-color components.