Disclosed is a somatosensory recognition system for recognizing a human body's action and a recognition method thereof. The somatosensory recognition system comprises: an acquisition device configured to acquire a first motion track data of a body parts' action; a wearable device worn on the body parts and configured to acquire a second motion track data of the body parts' action; and a processing device configured to compare the first motion track data and the second motion track data and determine the body parts' action according to comparison result. The above somatosensory recognition system and the recognition method thereof can improve the accuracy of somatosensory recognition.