A system for registering one or more cameras and/or creating an accurate three-dimensional (3D) model of a world space environment including back projecting at least one image from at least one of a plurality of camera views to the 3D model based on a set of existing camera parameters. The back projected image is added as a texture for the 3D model. This texture is automatically compared to one or more images from other camera views using a color space comparison of images to determine a set of differences or errors. The camera parameters and the 3D model are automatically adjusted to minimized the differences or errors. Over time, the parameters and the 3D model converge on a state that can be used to track moving objects, insert virtual graphics and/or perform other functions.