The present invention relates to a fuel cell stack structure, and more particularly, to a fuel cell stack structure in which unit cells are stacked, and second window frames, which each have an area larger than an area of a first window frame, are periodically disposed at a predetermined interval in a direction in which the unit cells are stacked, such that heat movement is promoted, a temperature deviation in the fuel cell stack structure is mitigated, and a temperature distribution is uniformized.