A dictionary data registration apparatus includes a dictionary configured to be registered a local feature amount for each region of an image with respect to each of a plurality of categories, an extraction unit configured to extract the local feature amount from a plurality of regions of an input image, a selection unit configured to select a plurality of the local feature amounts for each region according to a distribution of the local feature amounts extracted by the extraction unit from a plurality of regions of a plurality of pieces of input images which belongs to the category with respect to each of the plurality of categories, and a registration unit configured to register the selected plurality of local feature amounts on the dictionary as a local feature amount for each region with respect to the category.