An information processing apparatus includes a storing unit that stores information concerning model feature points and model feature quantities at the model feature points, a first acquiring unit that acquires an input moving image, a first feature-point extracting unit that extracts input feature points for recognizing an action from the input moving image, a first feature-quantity extracting unit that extracts input feature quantities at the input feature points, a feature-quantity comparing unit that compares the input feature quantities and the model feature quantities and generates candidate corresponding feature point pairs, a posture estimating unit that removes outliers from the candidate corresponding feature point pairs, estimates postures of models on the input moving image, and obtains a recognition corresponding feature point pair group corresponding to the postures, and a recognition-result generating unit that generates a recognition result on the basis of the recognition corresponding feature point pair group.