This disclosure describes a method of controlling an unmanned aerial vehicle (UAV). The steps of controlling include acquiring images with an image capture device of an unmanned aerial vehicle (UAV). The steps include analyzing the images to determine navigation information of the UAV with a vision-based navigation system. The steps include tracking a position of the UAV with the vision-based navigation system. The steps include controlling rotors of the UAV to prevent deviations in movement from a desired flight path or position of the UAV. The steps include limiting travel or flight of the UAV to a physical region determined by the desired flight path.