An approach is provided to process an image. The approach includes: obtaining a pixel shift set indicating information of movement of a plurality of pixels included in coinciding portions among a plurality of low-resolution images with respect to a single scene; dividing the pixel shift set into an integer portion and a fractional portion; generating an integer pixel shift set and a fractional pixel shift set; selecting a filter set corresponding to the plurality of pixels from among a plurality of pre-stored filter sets including a filter weight value applied to the pixels; and obtaining a high-resolution image with respect to the single scene, based on the plurality of low-resolution images, the selected filter set, and the integer pixel shift set.