The invention discloses a multi-viewpoint error resilient coding scheme based on disparity/movement joint estimation; video stream transmission coding is conducted on more than one viewpoint message; coding is conducted on each viewpoint by taking image groups as unit; and the last frame of each image group is a key frame while others are non-key frames. The coding scheme introduces an error control frame based on distributed video coding. Compared with the standard intra-frame coding, the method has higher coding efficiency and strong error resiliency performance and can still correctly decode even when a side message comes up with transmission error, thereby enhancing the transmission robustness of multi-viewpoint video streams.