A method and apparatus for controlling a motion-based user interface are provided. The apparatus includes a touch screen for displaying an image and for receiving input of a user touch on at least one spot of the touch screen, a sensor unit for sensing a motion of the apparatus, a motion calculator for calculating a degree of the motion of the apparatus, when sensing the motion of the apparatus at the sensor unit, and a controller for, when the at least one spot is touched on the touch screen, determining the number of touched spots, for receiving information about the degree of the motion of the apparatus from the motion calculator, and for determining whether to change the size of the image or the position of the image according to the number of touched spots.