Disclosed is an image processing apparatus in which a marked image is extracted more accurately and classification based upon the type of mark is made possible. The apparatus includes an extraction unit adapted to extract information representing a region position of an object and information representing a region position of a mark as an object list and mark list, respectively, from the document image that has been scanned by a scanning unit; and a search unit adapted to search for information representing the region position of a mark in the mark list for which the distance is the shortest with respect to information representing a region position of each object in the object list.