Provided is a face clustering device that detects a face included in an image, detects a direction of the detected face, detects, taking into account the detected direction of the face, a face with a similar feature and forms a collection of pieces of face information showing a feature of this face, narrows down, for each collection of pieces of face information which has been formed, the number of pieces of face information to a number set in advance for each face direction and sets each collection of pieces of face information for which the number has been narrowed down as a unit group, and performs, with the set unit group as a unit, clustering based on pieces of face information included in each unit group.