The invention discloses an ant colony aggregation cell tracking system assisted by potential estimation, which realizes the tracking of aggregated cells through the analysis of cell potential prediction and initial distribution module of pheromone field, ant search rule module, pheromone field existence probability update module and cell potential estimation and state extraction module. After theoriginal image is input, the cell potential is predicted by the existence probability of the pheromone field. The pheromone field is constructed by using a pheromone diffusion model based on a conicalcurve in an ant search mode based on pheromone gradient exponential form. On the basis, the existence probability of pheromone field is updated and the cell potential and state are estimated at the same time. Finally, the cell motion trajectory is obtained by using the distance relationship between cells, and the tracking of aggregated cells is realized. The invention can accurately estimate thenumber and the state of the aggregated cells, and has good tracking effect on the multicellular tracking of the cells entering or leaving the view.