A clustering unit first calculates a distance between a feature vector of a processing object pixel and a representative feature vector of a cluster to which a pixel with a high probability of belonging to the same cluster as the processing object pixel such as a nearby pixel of the processing object pixel belongs. When the calculated distance is less than or equal to a first threshold, the processing object pixel is allocated to a cluster to which the nearby pixel or a background image belongs.