The invention discloses an image recognition association algorithm management system and application thereof. The image recognition association algorithm management system comprises a main control computer unit module, a human brain thinking association algorithm module, an image acquisition and transmission module, a computer image recognition module and a database storage module; the main control computer unit module is connected with the image acquisition and transmission module, the human brain thinking association algorithm module, the computer image recognition module and the database storage module; the database storage module comprises a known personnel information data storage area, an associated personnel information data storage area and an unknown personnel information temporary storage area. According to the system, the structure is simple and reasonable, and operation is convenient; a relation network of associated personnel and unknown personnel can be quickly established, and identity information of entering personnel can be quickly judged; personnel who often go in and out can enter an entrance guard without needing to be companied by known personnel every time; the working efficiency can be improved, responsibility to the people can be achieved, and the known safety is improved.