A touch system with track detecting function includes a touch pad for sequentially sensing a plurality of positions of an indication object at a plurality of moments in order to detect a track of the indication object on the touch pad, and a processor for continuously generating motion vectors according to the track of the indication object on the touch pad, for generating a candidate motion vector according to at least one motion vector, and for nonlinearly generating a target motion vector according to the candidate motion vector in order to move a target shown on a display panel. Each of the motion vectors represents a difference between a position of the indication object and a next position of the indication object.