The present invention discloses a vehicle tracking system and method, and the tracking method comprises the steps of capturing a bright object from an image by the bright object segmentation; labeling the bright object by a connected component labeling method and forming a connected component object; identifying, analyzing and combining the characteristics of the connected component object to form a lamp object by the bright object recognition; tracking the trajectory of the lamp object by a multi-vehicle tracking method; and identifying the type of a vehicle having the lamp object by the vehicle detection/recognition and counting the number of various vehicles.