A handle structure for a draw bar of a luggage case includes a handle, a handle casing, a push member, and a connecting device. The handle includes two control members each having a movable member pivoted to a stationary member. The movable member includes a press portion and a reaction portion at two sides of the pivot point. The handle casing is fixed around the handle to hold the press portion. The push member has a head portion disposed in the handle casing and connected to the reaction portions, and a shaft portion extending out of the handle casing. The connecting device is fixed to the rod portion, and the shaft portion is inserted in the connecting device. When the press portion is subjected to a force in a direction, the reaction portion is moved toward that direction, the reaction portion moves the shaft portion toward the rod portion.