A handle structure suitable for disposing on a surface of a carrier is provided. The carrier has a locating part is assemble to a case. The handle structure includes a holder, an elastic element and a fastening element. The holder has a rotating axis and a locating element, and has a first end and a second end opposite thereto. The rotating axis connecting to the carrier is disposed on the first end, and the holder is pivoted on the surface. The locating element disposed on the first end interferes with the locating part. The elastic element has a first fixing part fixed to the carrier and a pushing part connected to the first fixing part and pushing against the holder. The fastening element has a second fixing part fixed to the carrier and a fastening part connected to the second fixing part and fastened to the second end.