The invention relates to a visible light infrared cascade video tracking method. The visible light infrared cascade video tracking method acquires tracking results of two data channels by adopting a method of cascading a visible light data channel and an infrared data channel, and accepts or rejects the tracking results. The visible light infrared cascade video tracking method takes the advantagesof the two channels in target detection into account, makes up for respective defects and improves the tracking capability.