Techniques for navigating semi-autonomous mobile robots are described. A semi-autonomous mobile robot moves within an environment to complete a task. A navigation server communicates with the robot and provides the robot information. The robot includes a navigation map of the environment, interaction information, and a security level. To complete the task, the robot transmits a route reservation request to the navigation server, the route reservation request including a priority for the task, a timeslot, and a route. The navigation server grants the route reservation if the task priority is higher than the task priorities of conflicting route reservation requests from other robots. As the robot moves within the environment, the robot detects an object and attempts to classify the detected object as belonging to an object category. The robot retrieves an interaction profile for the object, and interacts with the object according to the retrieved interaction profile.