The present invention provides a touch pad operable with multi-objects and a method of operating such a touch pad. The touch pad includes a touch structure for sensing touch points of a first and a second object and a controller for generating corresponding touching signals and related position coordinates. Moreover, the controller calculates at least two movement amount indexes according to coordinate differences between these position coordinates, thereby generating a movement amount control signal to control behaviors of a software object.