The present disclosure relates to systems and methods for selecting an action based on a detected person. In one implementation, a wearable apparatus may include a wearable image sensor configured to capture a plurality of images from the environment of the user of the wearable apparatus and at least one processing device. The at least one processing device may be programmed to analyze at least one of the plurality of images to detect the person; analyze at least one of the plurality of images to identify an attribute of the detected person; select at least one category for the detected person based on the identified attribute; select at least one action based on the at least one category; and cause the at least one selected action to be executed.