A wearable tracking system is provided. The wearable tracking system includes a wearable device, an external camera, and a processor. The wearable device is adapted to be worn on a body part of a user. The wearable device is configured to detect a body movement of the body part based on a tracking sensor. The external camera is configured to obtain a body image of the body part. The processor is configured to obtain a first moving track of a body moving track of the body part based on the body movement, obtain a second moving track of the body moving track of the body part based on the body image, and determine a body pose of the body part based on the first moving track and the second moving track.