A display device and a method of controlling the same are provided. The display device includes: a display panel including a plurality of pixels, each of which includes a plurality of sub pixels; a prism panel at one side of the display panel and including a prism array and a liquid crystal; a prism panel driver configured to apply voltage to the prism panel; and a controller configured to display a plurality of image frames on the display panel and to control a driving state of the prism panel variably while the plurality of image frames is displayed.