A handheld device including: a body with an operating surface; a touch sensor for sensing a touch on the operating surface to output a touch signal; a displacement sensor configured with the body for sensing a displacement of the body to output a displacement signal; and a processor receiving the touch signal to respectively generate a control command and disable the touch signal for a first time duration when the displacement signal is larger than a moving threshold.