A rotary shaft transmission structure, which is designed with a simplified structure to provide a smooth and stable transmission of a rotary shaft and to reduce the occurrence of rotational torsion variation of the rotary shaft, includes a combination of at least one rotor and a traction portion. The rotor includes a shaft hole and a bolt bore, in which the shaft hole is utilized to pivot the rotary shaft so that the rotor can be rotated by the rotary shaft, the shaft hole transversely passed through by at least a plan area is utilized to retain the traction portion, and the rotary shaft is utilized to press the traction portion via the plan area, thereby forming a fixation function.