Methods and devices for using uncertainty regarding observations of traffic intersections to modify behavior of a vehicle are disclosed. In one embodiment, an example method includes determining a state of a traffic intersection using information from one or more sensors of a vehicle. The vehicle may be configured to operate in an autonomous mode. The method may also include determining an uncertainty associated with the determined state of the traffic intersection. The method may further include controlling the vehicle in the autonomous mode based on the determined state of the traffic intersection and the determined uncertainty.