Various examples are directed to systems and methods for directing a field-of-view of a first sensor positioned on an autonomous vehicle. In one example, at least one processor selects a goal location on at least one travel way in an environment of the autonomous vehicle. The selecting of the goal location is based at least in part on map data describing at least one travel way in an environment of the autonomous vehicle and pose data describing a position of the autonomous vehicle in the environment. The at least one processor determines a field-of-view position to direct the first sensor towards the goal location based at least in part on the sensor position data. The at least one processor sends a field-of-view command to the first sensor. The field-of-view command modifies the field-of-view of the first sensor based on the field-of-view position.