A method and apparatus for stereoscopic panoramic video generation includes novel techniques for panorama projection, stitching and calibration for various depth planes. The apparatus includes a polygonal camera head (40) having multiple sides (42) and a circular projection center (44) located within the polygon. Each side of the polygon has a pair of cameras (46a, 46b) for capturing image scenes. The cameras (46a, 46b) are arranged such that image projection lines (48) extending from the cameras are perpendicular to the side upon which the camera is located and tangent to one side of the circle of the projection center. Projection surfaces (50) are warped such that the image projection lines are also perpendicular to the projection surfaces. Stereoscopic panoramic video is generated with no occlusion of the scene by the capturing apparatus and no visible perspective errors or image mosaic artifacts.