Provided are an image processing apparatus, an image processing method, and a program that can highly efficiently execute a generation process of a color image based on an image including a plurality of pixel sets each including a plurality of single-color pixels arranged in a predetermined color pattern, in which the pixel sets are vertically and horizontally arranged side by side. An intermediate image generation unit (64) generates, based on a basic image, an intermediate image in which pixel values of a plurality of basic pixels included in the pixel set are set as values of intermediate pixel data of one intermediate pixel associated with the pixel set. A pixel value determination unit (70) determines pixel values of a plurality of colors of at least one final pixel associated with a target intermediate pixel based on values of the intermediate pixel data of the target intermediate pixel and values of the intermediate pixel data of the intermediate pixel adjacent to the target intermediate pixel. A final image generation unit (72) generates a final image based on pixel values of a plurality of colors of a plurality of final pixels.