The present invention relates to a fuel cell stack structure and, more specifically, to a fuel cell stack structure having unit cells stacked therein, wherein second window frames lager in area than first window frames are arranged at regularly periodical intervals in the unit cell stacking direction, thereby promoting the movement of heat to make a low temperature deviation and a uniform temperature distribution across the fuel cell stack structure.