The technology relates to determining whether a vehicle operating in an autonomous driving mode is experiencing an anomalous condition, for instance due to a loss of tire pressure, a mechanical failure, or a shift or loss of cargo. The actual current pose of the vehicle is compared to an expected pose of the vehicle, where the expected pose is based on a model of the vehicle. If a pose discrepancy is identified, the anomalous condition is determined from information associated with the pose discrepancy. The vehicle is then able to take corrective action based on the nature of the anomalous condition. The corrective action may include making a real-time driving change, modifying a planned route, alerting a remote operations center, or communicating with one or more other vehicles.