An image processing method and apparatus are provided. The image processing method includes converting an input image to a first channel separated image having a same resolution as the input image, the first channel separated image comprising a plurality of separate channels, generating a second channel separated image by performing a convolution operation on the first channel separated image, the second channel separated image comprising the plurality of separate channels and having a same resolution as the first channel separated image, and generating a restored image corresponding to the input image based on the second channel separated image.