An intoxication detection system of a vehicle includes: a passive breath sensor configured to measure an amount of an intoxicant present within a passenger cabin of the vehicle; a camera configured to capture images including a driver on a driver's seat within the passenger cabin of the vehicle; an intoxication indication module configured to: selectively determine that the driver is intoxicated when the amount of the intoxicant is greater than or equal to a predetermined amount of the intoxicant; trigger performance of a test to confirm whether the driver is intoxicated when the amount of intoxicant is greater than or equal to the predetermined amount of the intoxicant; and selectively indicate that the intoxication of the driver is confirmed when nystagmus is detected in the driver based on images from the camera during performance of the test.