An image processing apparatus and method are provided. The image processing apparatus includes: a memory configured to store at least one instruction, and a processor electrically connected to the memory, wherein the processor, by executing the at least one instruction, is configured to: apply an input image to a training network model; and apply, to a pixel block included in the input image, a texture patch corresponding to the pixel block to obtain an output image, wherein the training network model stores a plurality of texture patches corresponding to a plurality of classes classified based on a characteristic of an image, and is configured to train at least one texture patch, among the plurality of texture patches, based on the input image.