The display apparatus includes: a display; a decoder which decodes an image in unit of a MCU; a scaler which scales the decoded image; a memory which stores the scaled image; and a controller which controls the display to display the scaled image, sets an RAU structure of the image, and further stores in the memory image information corresponding to the RAU structure. Thus, even if a decoded and scaled image is zoomed in, the quality of the zoomed image may be maintained at a high level.