Provided is an image processing method and apparatus for removing blur in a screen image, including detecting blur in an input image, segmenting the image according to an amount of the detected blur, performing a high pass filtering of the segmented image in a horizontal direction and a vertical direction, detecting corresponding weights by using corresponding coefficients of each direction obtained from filtering; and restoring the image by applying the detected weights to one of: an iterative form or a closed form of an image restoration.