A hand-held rotary tool is provided which can offer improved usability while realizing reduction of vibration of a tool body. The rotary tool has a tool body, a drive shaft disposed in the tool body, a driven shaft to which a tool bit is attached, an Oldham's coupling that transmits rotation of the drive shaft to the driven shaft, and an elastic element disposed between the driven shaft and the tool body. The driven shaft is prevented from moving in a longitudinal direction of the driven shaft relative to the tool body and allowed to move in a direction transverse to the longitudinal direction of the driven shaft relative to the tool body. During this relative movement, power transmission from the drive shaft to the driven shaft is maintained via the Oldham's coupling. The elastic element absorbs the movement of the driven shaft relative to the tool body.