The invention relates to manifold mosaic hopping for image-base rendering (IBR). In one embodiment, a set of manifold mosaics is constructed. Depending on the desired application, the mosaics can be concentric mosaics, parallel mosaics, as well as other types of mosaics. Each mosaic represents a number of unique viewpoints that different from one another in only one direction. From a current camera or viewing position within the set of mosaics, a new position can be moved to, such that the movement is continuous over any one mosaic, and is discrete across the mosaics. An image is rendered by local warping, without interpolation of more than one mosaic.