The invention discloses an intelligent personnel counting system based on the video frequency, and the processing method thereof. The intelligent person counting system comprises an image acquisitionmodule used for monitoring an appointed region, and a personnel number estimating module, the personnel number estimating module processes an image obtained from the image acquisition module and comprises four modules of a background estimating module, a personnel number estimating module based on the detection of a foreground block, a personnel number estimating module based on the head part detection, and an integrated detection result module. The setting of the four modules is realized through a general-purpose computer, and the four modules are used for gathering a video image in the appointed region in real time and combining with the personnel number estimating way based on the detection of a foreground block and the personnel number estimating module based on the head part detectionto calculate the personnel number in the appointed region. By adopting a photographing device and a calculating processing device, the system and the method of the invention can automatically realizethe statistics and the calculation to the personnel number in the appointed region, and the monitoring to the personnel number in the appointed region.