An image processing device comprising: an imaging unit outputting frames of image data sequentially in order of imaging; a first generation unit generating first image data sequentially in units of a predetermined number of consecutive frames of image data, from the output frames of image data, wherein a total exposure time of each piece of first image data is a first time period; a second generation unit generating second image data sequentially in units of the predetermined number of consecutive frames, from the output frames of image data, a total exposure time of each piece of second image data is a second time period different from the first time period; and an output unit outputting each pair of first image data and second image data generated from a same set of the predetermined number of consecutive frames of image data, in correlation with each other.