The invention discloses a key management system based on face recognition. The key management system comprises a camera, an upper computer, an RS232-to-RS485 module, a key controller an a key cabinet, wherein the upper computer is connected with the camera and the RS232-to-RS485 module and controls the camera to acquire a face image; after being processed, the face image is compared with images in a face database, and a control instruction is sent to the RS232-to-RS485 module if the face image is successfully matched with an image in the face database; the key controller is connected with the RS232-to-RS485 module and an electric control lock and is used for matching a target address of the control instruction sent from the RS232-to-RS485 module with an own address and controlling the electric control lock to open or close a drawer of the key cabinet if the target address of the control instruction is successfully matched with the own address. The key management system ensures that keys and users are in one-to-one correspondence, is high in reliability and high in expandability and performs scientific and concentrated management on keys.