The invention provides an information processing apparatus, an information processing method and a program. There is provided an information processing apparatus including: a sensor data generator sensing a user behavior and generating sensor data corresponding to the user behavior; a behavior recognizing unit performing a predetermined threshold value process on the sensor data to recognize the behavior exhibited by the user and generating behavior information that is information indicating the behavior exhibited by the user; a behavior manager managing the behavior information generated by the behavior recognizing unit in correspondence with the time point at which the behavior corresponding to the behavior information is exhibited; and a behavior information post-processing unit performing a predetermined post-process on the behavior information managed by the behavior manager, wherein the behavior recognizing unit further includes a plurality of behavior determination units specified to specific behaviors exhibited by the user and generates the behavior information based on the determination results of the plurality of behavior determination units.