An image processing apparatus and a method of controlling the image processing apparatus are provided. The image processing apparatus includes a memory unit; and a processor configured to store image data of all pixels of a zone set in a first image frame in an area of the memory unit, which corresponds to the zone, when at least one of the pixels of the zone does not satisfy a predefined condition, and not to store image data of each of the pixels of the zone in the area of the memory unit, which corresponds to the zone, when all the pixels of the zone satisfy the predefined condition.