The invention provides a multi-user cooperative assembly system and method, and the system comprises the steps: capturing the positions of multiple users and user gesture recognition in real time through external positioning equipment, and enabling the positions and the user gesture recognition to serve as input data; Camera rendering parameters are changed by using the obtained data, so that a multi-view rendering scene is realized without causing virtual imaging position offset; The two projectors are used for displaying the three-dimensional images of the left eye and the right eye of multiple users, and the function that multiple persons can observe the same projection area but can observe different images is achieved. The user information content is controlled, and the registration and login functions of the user are realized; Learning materials in the disassembling and assembling process are provided in an animation mode; Editing the virtual object by multiple users, and feedingback a scene to a user operation result.