A handle connection structure, wherein a lever shaft (50) is fixed to the base part of a handle (6). A shaft (57) is fixed to the lever shaft (50), and a rear bracket (71) is rotatably mounted on the shaft (57). A first gear part (53) is formed on the lever shaft (50) and a second gear part (73) is formed on the rear bracket (71), and a ring gear (98) is fitted onto the outsides of the first and second gear parts (53) and (73). An internal gear (99) meshed with the first and second gear parts (53) and (73) is formed on the inner peripheral side of the ring gear (98). The ring gear (98) is energized to the first gear part (53) side by a return spring (106). When the ring gear (98) is moved to the second gear part (73) side against an energizing force, the meshing of the first gear part (53) with the internal gear (99) is released, the lever shaft (50) becomes rotatable relative to the rear bracket (71), and the handle (6) can be stored.