A touch panel control device may be provided that includes: a touch panel which generates at least one touch signal in response to a touch of an object; a displayer; and a controller which performs a first touch action mode in which the change of the touch position of the object is displayed on the displayer by a line in response to the object which has touched the touch panel, and performs a second touch action mode in which, in response to the position change of the object which corresponds to the position of the line displayed on the displayer, it is to carry out at least one of the removal of at least a portion of the line displayed on the displayer and the change of the color coordinate of the line. Also, a method for controlling the touch panel may be also provided.