A driver fatigue realtime detection method based on the vision, belongs to the application technical field of the electronic technology, characterized in that, the continuous simulation signals through the infrared filter collected by the pick-up head are converted into the digital image signals through the A/D conversion of the image collection module; the image collection module completes the operating process on the digital image signals, including the pretreatment of the image, the image division, the feature extraction and the fatigue recognition; finally the processing result is displayed through the output module. The hardware in divided into three large modules: an image collection module, an image process module and an image output module. The image collection module includes an infrared sensitive black and white CCD camera, an infrared band-pass filter, an infrared source with a cradle head; the image process module is composed of the TMS320DM642 of the American TI company as the central part; the image output module is a LCD; the system is arranged in the inner of the cab. The invention has the advantages of easy realization, good realtime, higher accuracy of the judgment result, which provides the basis for the real application.