A robotic navigation system includes a handheld navigation unit associated with a frame of reference. The handheld navigation unit is moveable with respect to a plurality of axes and is configured to send movement signals based on movement of the handheld navigation unit. A controller is configured to receive the movement signals from the handheld navigation unit and determine control signals for the robot. The control signals are configured to incrementally move the robot with respect to a point of interest removed from the robot. The point of interest is removed from a fixed point on the robot as defined by assigned coordinates. The controller is further configured to reassign the assigned coordinates following each incremental movement of the robot.