Head mounted display, HMD, with forward facing camera(s) for Mixed Reality or Merged Reality (MR), sometimes called Augmented Reality (AR). The user wearing the HMD can walk around the real world seeing virtual objects, static or moving, superimposed over actual objects. The available scenes is used to recognize objects and then to fill in the occluded or partially scanned regions based on the expected geometries of those objects.