In a histogram intersection calculating apparatus, a histogram intersection calculating unit calculates a histogram intersection to compare histograms of query data and target data to obtain a score value of the histogram intersection. A calculation controlling unit makes the histogram intersection calculating unit calculate the histogram intersection in descending order of bin number of the histogram of the query data from the bin number having the maximum frequency value by using frequency values in the bin numbers of the query data and frequency values in the bin numbers of the target data to obtain a score value of the histogram intersection.