The invention provides a remote sensing image semantic retrieval method and a remote sensing image semantic retrieval system based on an object level association rule. The method comprises the steps of selecting a training image according to the kind of the remote sensing image, and dividing the training image for obtaining a plurality of objects; according to the object attribute, calculating an attribute quantized value of each object; constructing an object affair set for aiming at the attribute quantized value of each object, calculating an association rule of the object affair set, training the association rule and an affiliated kind by means of a machine learning algorithm, obtaining a plurality of kinds of training models, repeating the steps above for acquiring the association rule of each image, inputting the association rule into the training model, outputting the membership degree of each kind, using a vector which is composed of a membership degree value as a semantic description of the image, and calculating the distance between the semantic vectors of the two images for calculating similarity between the two images. According to the remote sensing image semantic retrieval method and the remote sensing image semantic retrieval system based on the object level association rule, image retrieval is performed by means of an association rule digging method, thereby supplying a new approach for remote sensing image semantic retrieval.