A system for managing face data includes a global face capturing unit configured to capture a global face image; and a global face data generation unit configured to obtain shape information and texture information of global face data, and generate the global face data. Further, the system includes a local face capturing unit configured to capture a plurality of local face images; and a global face posture extraction unit configured to estimate a position and a direction of the face of a captured user. Furthermore, the system includes a local capturing device posture extraction unit configured to extract posture information of the local face capturing unit; and a local face data generation unit configured to generate texture information and shape information, and generate local face data.