An imaging and processing device includes: an optical element; a single imager with a color filter array of a plurality of colors attached thereto for outputting a value according to an amount of light which has been guided by the optical element and transmitted through the color filter array, thereby enabling to obtain separate images of the plurality of colors for every frame time point; a first adder section for adding together values, associated with a first color of the plurality of colors, of different images obtained over a plurality of frame time points; a second adder section for adding together a plurality of values, associated with a second color of the plurality of colors other than the first color, of an image captured at a single frame time point; and an image restoring section for restoring an image including a plurality of colors at each frame time point from an image based on the first color which has been subjected to the addition by the first adder section, and an image based on the second color which has been subjected to the addition by the second adder section.