A recognition apparatus for recognizing a position and an orientation of a target object, inputs a captured image of the target object captured by an image capturing apparatus; detects a plurality of feature portions from the captured image, and to extract a plurality of feature amounts indicating image characteristics in each of the plurality of feature portions; inputs property information indicating respective physical properties in the plurality of feature portions on the target object; inputs illumination information indicating an illumination condition at the time of capturing the captured image; determines respective degrees of importance of the plurality of extracted feature amounts based on the respective physical properties indicated by the property information and the illumination condition indicated by the illumination information; and recognizes the position and the orientation of the target object based on the plurality of feature amounts and the respective degrees of importance thereof.