The present disclosure provides systems and methods for tracking vehicles or other objects that are perceived by an autonomous vehicle. A vehicle filter can employ a motion model that models the location of the tracked vehicle using a vehicle bounding shape and an observation model that generates an observation bounding shape from sensor observations. A dominant vertex or side from each respective bounding shape can be identified and used to update or otherwise correct one or more predicted shape locations associated with the vehicle bounding shape based on a shape location associated with the observation bounding shape.