The invention discloses a real-time processing method and system of image data of an unmanned plane. According to the method, matching of combined characteristic information of continuous image data is carried out; a characteristic extraction and matching process based on FREAL and SIFT characteristic combination is used and an image data real-time requirement of the unmanned plane is met. Under the circumstances of no POS information assistance, estimation of attitude data of continuous image data is carried out based on SFM by using a characteristic matching result; and flight track recovery of multiple segments of the unmanned plane is carried out and frame image data at each segment are marked. And then on the basis of the frame image data marked with segment marks, image splicing is carried out based on the characteristic matching result to generate a corresponding spliced image. On the basis of the method, a problem that the telemeasuring data can not be obtained or time-space matching is poor can be solved. And an objective that image data of the unmanned plane can be processed in real time under the circumstances of no POS system assistance can be achieved.