There is provided an apparatus for removing color noise including: a color interpolation unit performing color interpolation on a bayer pattern image output from an image sensor; a high-pass filter unit performing high-pass filtering on each of the pixels of the bayer pattern image to generate high-pass filtered values of each of the pixels; a high frequency region determining unit comparing pixel values of a target pixel, from which color noise is removed, and pixels adjacent to the target pixel with the high-pass filtered values to determine whether the target pixel is included in a high frequency region; and a color noise region determining unit using differences between color values of the target pixel interpolated by the color interpolation unit and determining whether the target pixel is included in a color noise region when it is determined that the target pixel is included in the high frequency region.