The invention provides an image annotation information processing method, device and system. The method comprises the following steps: obtaining captured images from a terminal, and corresponding shooting position, and performing object identification on the shot image; determining a first object presented by the shot image, and in the historical images associated with the shooting position, querying a first target image presenting the first object; if the first target image is queried, determining that the first object is repeated with annotation information in the electronic map, and if thefirst target image is not queried, marking the first object at a corresponding position in the electronic map according to the shooting position. According to the invention, the method achieves the quick recognition and processing of the object presented in the terminal photographing image through the obtaining of the terminal photographing image, the repetition judgment of the object presented inthe terminal photographing image, and the marking of the corresponding position of the electronic map according to the result, and improves the efficiency of obtaining the interest point informationof the electronic map.