Abstract:
Real-time video targeting and exploration system that allows users to pause, step into, and explore modeled worlds of scenes in video. The system may leverage network-based computation resources to render and stream new video content from the models to clients with low latency. A user may pause a video, step into a scene, and interactively change viewing positions and angles to move through or explore the scene, as well as interactively explore objects associated with the scene. The user may step into and explore the scene within the scope of the model to discover parts of the scene that are not visible in the original video, as well as objects within the scene that may not have been readably observable in the original video. In addition, at least some content of a video may be replaced with content targeted at particular viewers according to viewers' profiles or preferences.