An apparatus and method for searching for a building on the basis of an image and a method of constructing a building search database (DB) for image-based building search. The method includes constructing a building search DB, receiving a query image from a user terminal, detecting a region to which a building belongs in the query image, extracting features of the region detected in the query image, and searching the building search DB for a building matching the extracted features. Therefore, building search performance can be improved.