A system and method for autonomous vehicle routing using annotated maps. For at least some path segments within a geographic region in which the vehicle is operating, values are determined for the path segments based at least on risk factors associated with autonomous operation of the vehicle along each path segment. Path segments are combined to generate a travel route, from a first location to a second location, based on the determined values, and the vehicle is controlled to navigate along the travel route.