A method and an apparatus for processing video image data are disclosed in the embodiments of the present invention. The method includes: obtaining multiple channels of correlative video image data and correlative information; combining the multiple channels of correlative video image data into a single channel of panoramic video image data by using the correlative information; and after recombining the panoramic video image data into multiple channels of video image data satisfying a display requirement of multiple display devices, respectively sending each channel of recombined video image data to each display device for display. Therefore, an overlapping phenomenon existing in images shot by a camera may be allowed, so that requirements on a location where a camera is placed and a distance between a user and a camera set are lowered.