The invention discloses a driver emotion recognition-based automatic driving mode switching system, which comprises a driver physiological information monitoring module, a road rage status recognitionmodule, a driving mode switching module and an automatic driving module, wherein the driver physiological information monitoring module comprises heart rate and blood oxygen sensors arranged at the two end parts of the horizontal axis of a steering wheel, and the road rage status recognition module constructs an off-line training and online recognition model of driver rage emotion to perform online recognition of the driver rage emotion; when the road rage status recognition module judges that a driver is angry, the driving mode switching module switches a vehicle driving mode into an automatic driving mode to disable the operation of the driver on a vehicle; when confirming that the driver is ready for taking over, the driving mode switching module switches the vehicle driving mode fromthe automatic driving mode into a manual driving mode; the automatic driving mode module comprises an ACC (Adaptive Cruise Control) system for realizing longitudinal automatic control of a vehicle andan LKA (Lane Keeping Assistance) system for realizing lateral automatic control of the vehicle.