This document describes methods and systems directed at history-based identification of incompatible tracks. The historical trajectory of tracks can be advantageous to accurately determine whether tracks originating from different sensors identify the same object or different objects. However, recording historical data of several tracks may consume vast amounts of memory or computing resources, and related computations may become complex. The methods and systems described herein enable a sensor fusion system of an automobile or other vehicle to consider historical data when associating and pairing tracks, without requiring large amounts of memory and without tying up other computing resources.