A user terminal device is provided. The device includes a display configured to display a screen including an object, a detector configured to detect a user drawing input which is input on the object or in an area surrounding the object, a controller configured to, in response to the user drawing input being detected, execute a program corresponding to the object and display, on the display, a screen where the user drawing input is processed as an input of the program. Accordingly, the operations of the user terminal device may be controlled conveniently.