The present invention is to provide an eyeglass temple structure, which includes a temple having a plate-shaped body formed with a through hole, a temple connector being extended with a fixing ring, and a pivotal hinge structure including a cylindrical pivot body and a fastening insert. The pivot body has a middle section formed with a groove for engaging with the fixing ring, and is axially formed with an aperture. The fastening insert is engaged in the aperture and can pivot with the pivot body, so as to form the pivotal hinge structure having replaceable elements for pivotally connecting the temple to the temple connector and allowing the temple to pivot with respect to the temple connector. Thus, the pivotal hinge structure can be easily engaged with the fixing ring via the groove of the pivot body and inserted in the through hole of the temple.