Provided is a method of generating multi-view immersive content. The method includes obtaining a multi-view background image from a plurality of cameras arranged in a curved shape, modeling the obtained multi-view background image to generate a codebook corresponding to the multi-view background image, obtaining a multi-view image including an object from the plurality of cameras and separating a foreground and a background from the obtained multi-view image by using the generated codebook, and synthesizing the object included in the separated foreground with a virtual background to generate multi-view immersive content.