According to the present invention, since a color image for a moving image including that for live view display includes image data on pixel lines including first and second phase difference pixels, phase difference AF can be accurately performed during the moving image taking. A color image for the moving image includes not only the image data on the pixel lines including the first and second phase difference pixels, but also image data on pixel lines that do not include the first and second phase difference pixels and only include normal pixels. Accordingly, the image quality of the color image for the moving image is improved, an image interpolation process can be accurately performed, and reduction in image quality of a taken image (still image and moving image) through the phase difference pixels can be prevented or alleviated.