Systems and methods for tracking objects in a field of view are disclosed. In one embodiment a method may include capturing, via a camera, a real-world object in the field of view; generating a first object data associating the real-world object with a first position of the real-world object in a real-world environment at a first time; generating a virtual object representative of the real-world object depicting the real-world object in the first position at the first time; generating a second object data associating the real-world object with a second position of the real-world object in the real-world environment at a second time, determining a displacement value of the real-world object between the first position and the second position, modifying the virtual object to include an indication that the real-world object has been displaced when the displacement value is greater than a threshold value.