In an image retrieving apparatus for retrieving a retrieving image in an input image, a color histogram of an image in a retrieving area in the input image is compared with a color histogram of the retrieving image. At first, a candidate area in which the retrieving image can be included is roughly retrieved by rough image retrieving with selecting a larger retrieving area and a rough resolution of gradation of the histograms. Subsequently, an area including an image corresponding to the retrieving image is precisely retrieved by fine image retrieving with a smaller retrieving area and a fine resolution of gradation of the histograms.