A hand tool includes a handle and a holding member is connected to the front end of the handle. A first part is connected to one end of the holding member and is connected to a second part connected to the front end of the handle. The first part has a first recess defined transversely therethrough. A second recess and a third recess are respectively in one side of the first part and communicate with the first recess. The second recess is located between the first and third recesses. A control unit has two pins which are movably cooperated with the first, second and the third recesses. The second pin is connected to the first pin. When pushing the first pin toward the second pin, the first part is shifted from the second part so that a blade is inserted into or removed from the first and second parts.