A method and apparatus with image processing are disclosed. The method includes determining a real part image, an imaginary part image, and an offset image based on input images that are dependent on infrared rays of different phases, removing noise from each of the real part image and the imaginary part image using the offset image as a noise removal guide, and generating a depth image based on an improved real part image and an improved imaginary part image corresponding to respective results of the removing.