A computer-implemented method, system, and computer-readable medium is disclosed for determining a sequence order for vehicles in one or more image frames from an operational video, the operational video acquired from a fixed video camera comprising a field of view associated with a vehicle merge area where upstream traffic from a first lane and upstream traffic from a second lane merge to a single lane. The method can include obtaining operational video from a fixed video camera; detecting, within a region of interest (ROI) of the one or more image frames from the operational video, a first area and a second area in the vehicle merge area using a trained classifier that is trained to detect the first area and the second area; and determining the sequence order of the vehicles based on the first area and the second area that are detected.