The invention discloses an unmanned excavation system and method based on natural interaction in complex construction environment, and belongs to the field of unmanned excavation systems. According tothe system and method, a holographic electronic fence, a force feedback unit and an unmanned excavator are controlled to finish corresponding actions according to bimanual gesture commands sent froma bimanual gesture control unit, and the unmanned excavator remains a safe distance from surrounding environment according to the visual electronic fence shown through a holographic electronic fence unit; when a bucket meets underground obstacles, sensed force information is transmitted to a remote operator through a force sensing module by using the force feedback unit; and the remote operator senses the obstacles through a force simulation module, and accordingly sends next excavation commands through the bimanual gesture control unit. According to the unmanned excavation system, based on gesture recognition control, the natural interaction between the remote operator and the unmanned excavator is achieved, and the action of the excavator can be fed back; interaction with the surroundingenvironment can be further performed, and the safety of the excavation work is improved; and the occurrence probability of field safety accidents is reduced.