Methods, systems, and apparatus including medium-encoded computer program products for generating and visualizing 3D scenes include, in one aspect, a method including: obtaining site data acquired by one or more capture devices, wherein the site data comprises data sets corresponding to two or more locations about a physical site, and each respective data set comprises (i) imaging data of the physical site, (ii) coordinate data for the imaging data, and (iii) time metadata for the imaging data; reconstructing a series of three dimensional (3D) modeled scenes of the physical site from the site data using the imaging data, the coordinate data, and the time metadata; receiving a request having associated position, orientation and time data; and generating, in response to the request, output for display of a portion of the 3D modeled scenes to represent the physical site based on the position, orientation and time data.