There is provided an image analysis system which captures image data of an arbitrary pair of a first image RI and a second image LI among images obtained by color-photographing a single object from different positions into an analysis computer, wherein the computer includes corresponding point extraction means for assigning a weighing factor to a pixel information value based on the contrast size of the pixel information value in each of a first local area ROI1 set around an arbitrary reference point in RI and second local areas ROI2s at which scanning is performed on LI, calculating the similarity between ROI1 and ROI2s, and extracting a corresponding point which corresponds to the reference point from a ROI2 having the highest similarity, and depth information calculating means for calculating depth information of the object based on coordinates of the reference point and the corresponding point.