The invention discloses a high-rise building characteristic point matching method in an ultrahigh resolution remote sensing image. The method aims at a problem that characteristic point pairs which fall on a high-rise building are reduced since the spatial position of the high-rise building in a city changes in the ultrahigh resolution remote sensing images of different angles of view, an extraction method of various characteristic points is adopted in a reference image and an image to be registered to obtain a great quantity of characteristic points. For the characteristic point pair which is primarily matched, firstly, a strict screening condition is adopted to obtain a small quantity of characteristic point pairs with high matching accuracy, an image angle-of-view difference between images is analyzed, the image angle-of-view difference and the image displacement difference of a building are used for relaxing the screening condition, more characteristic point pairs which simultaneously contain errors and correctness can be obtained, finally, the characteristic point pairs are further verified through the similarity of image blocks around the characteristic point pairs, wrong characteristic point pairs are removed, and more correctly-matched characteristic pairs are kept.