Provided are a touch sensor device and a pointing coordinate determination method thereof. The touch sensor device includes a touch panel, a touch sensing unit that receives a touch signal, senses touch information according to a simple touch or touch strength of a touch object, and outputs an electrical signal, a touch data storage that stores touch data in response to the electrical signal, a template storage that pre-stores templates for various outlines of the touch object in response to the electrical signal, and a touch data processor that senses an outline of the touch object according to a distance difference related to the touch object by receiving the touch data, and determines pointer coordinates of a pointing device by receiving and mapping a stored template of the touch object.