A stereoscopic image processing method for extracting a plurality of dots, i.e., a pixel unit, from a plurality of viewpoint images by each viewpoint image. Data of the plurality of dots serving as a pixel unit is extracted from each viewpoint image, and an aggregate of such the data is defined as a pixel group. A dot cluster of 21 dots surrounded by bold lines constitutes one pixel group. An aperture 1 corresponds to each pixel group, and from a specific observing position, dots in three colors of {1; 11; R}, {1; 11; G}, and {1; 11; B} constituting an upper left pixel of a viewpoint 1 are simultaneously observed. An arrangement of pixels in the pixel group is set so that an aspect ratio of a displayed pitch of the pixel group is rendered most approximate to 1:1.