The present invention is a method and apparatus for automatic image segmentation using template matching filters. The invention generally segments differing binary textures or structures within an input image by passing one or more structures while removing other structures. More particularly, the method and apparatus segment a stored binary image using a template matching filter that is designed to pass therethrough, for example, text regions while removing halftone regions.