There are provided an image processing apparatus, an image processing method, a program, and a recording medium capable of calculating the actual intimacy between persons even in a case where there is a deviation in the actual intimacy between persons by calculating the intimacy between persons in consideration of only the contents of images. In the image processing apparatus, the image processing method, the program, and the recording medium of the invention, a person specifying unit determines persons appearing in each image, and specifies one or more first persons among the determined persons. An intimacy calculation unit calculates the intimacy between the first person and each photographer based on the presence of a first person in each image and photographer information of each image.