What is disclosed is a system and method for performing a background deletion that exploits both local and global context to remove background and other white space between objects with the aim of retaining structural relationships between objects in the document. A document image is received and seams are carved through the image. Seams composed of uniform background pixels are identified. Adjacent seams containing background pixels are collected into groups of seams. The background seam groups are classified according to their widths. A target number of seams to be removed for each background seam group is then determined based on the classification. Seam groups which are wider will have at least the same or a greater target number of seams to be deleted therefrom than will seam groups of narrower widths. The document image is then resized by deleting seams from the seam groups based on the assigned target number.