A method for removing defective pixels using a signal processing scheme with a Bayer pattern, by determining an output value of the inter-channel according to whether or not a difference between a center pixel and an average of neighboring pixels, which have the same color as that of the center pixel, is greater than or equal to a threshold value; and using values of neighboring pixels nearest to a center pixel as an input, obtaining an output value of the cross-channel by finding a median value among a median value of vertical and horizontal lines including the center pixel, a median value of diagonal lines including the center pixel, and a value of the center pixel. Then, a defective pixel is removed, through the use of the output value of the inter-channel, the output value of the cross-channel, and the value of the center pixel.