A method and system of sensing facial gestures are disclosed. The method of sensing facial gestures includes determining a basic database (DB) for sensing facial gestures of a user, estimating a head pose of the user, extracting a mesh model corresponding to the estimated head pose using at least one of a personalized DB and a general DB, and sensing the facial gestures using the extracted mesh model, and reflecting the sensed facial gestures to a virtual object.