In some embodiments, aerial images of a geographic area are captured by an autonomous vehicle. In some embodiments, the locations of structures within a subset of the aerial images are manually annotated, and geographical locations of the manual annotations are determined based on pose information of the camera. In some embodiments, a machine learning model is trained using the manually annotated aerial images. The machine learning model is used to automatically generate annotations of other images of the geographic area, and the geographical locations determined from the manual annotations are used to determine an accuracy probability of the automatic annotations. The automatic annotations determined to be accurate may be used to re-train the machine learning model to increase its precision and recall.