The invention relates to horizontal and vertical line detection and removal for document images and provides a method of removing horizontal and vertical lines from a document. The horizontal line removal method includes: for a column of black pixels at each horizontal position along the line, removing them if their maximum stroke width is less than the median value of maximum stroke widths in a small window centered at that horizontal position; Remove connected components remaining in the horizontal line bounding box that do not extend significantly above or below the bounding box boundaries; and Perform closing operation to join broken pieces of character strokes caused by underline removal. This method preserves character strokes while removing underlines. The vertical line removal method includes: for vertical lines that have large height to width ratio, remove parts of such lines that are not at intersection of with horizontal or near-horizontal lines; remove all remaining connected components that touch neither left nor right boundary of the bounding box.