The present invention relates to a headrest moving device, more particularly, relates to a headrest moving device wherein the user convenience is enhanced since the contact position between the moving unit and the return spring is changed according to the position of the headrest so that the forces being applied by a user are same or similar, that is, there is no significant difference in the operational forces when moving the headrest to either the minimum position or the maximum position thereof.