A method of processing a stereoscopic video includes determining whether a current frame of a stereoscopic video is a video segment boundary frame; determining whether an image error is included in the current frame when the current frame is the video segment boundary frame; and processing the current frame by removing, from the current frame, a post inserted object (PIO) included in the current frame when the image error is included in the current frame.