Aspects of the disclosure relate to maneuvering a vehicle. As an example, sensor information identifying a set of objects as well as a set of characteristics for each object of the set of objects is received from a perception system of a vehicle. The set of objects is filtered to remove objects corresponding to vehicles, bicycles, and pedestrians. An object within an expected future path of the vehicle is selected from the filtered set of objects. The object is classified as drivable or not drivable based on the set of characteristics. Drivable indicates that the vehicle can drive over the object without causing damage to the vehicle. The vehicle is maneuvered based on the classification such that when the object is classified as drivable, maneuvering the vehicle includes driving the vehicle over the object by not altering the expected future path of the vehicle.