A display apparatus includes an image acquiring unit configured to acquire a user image, an image processing unit configured to sense a motion of a user from the user image, and a control unit configured to control a pointer displayed on a screen of the display apparatus to be moved to a target position in response to the sensed motion of the user, and control the screen to be scrolled according to the target position.