A method for generating a desired view of a real scene from a selected desired viewpoint by identifying objects in a real image, determining the positions of the identified objects, and rendering a view of the scene from a selected viewpoint using image data from the real image to render at least some of the identified objects. Other portions of the rendered view can be rendered using other source data which may be generic or historic. Identified objects may be tracked over a period of time to determine a trajectory or path: A user interface can be provided to assist in object tracking. A number of cameras can be used to provide a number of real images, and certain cameras may be controlled using the parameters of other cameras.