A premixed material is obtained by tempering a castable refractory powder composition comprising refractory aggregate, fine refractory powder, alumina cement, a dispersing agent and an alumina cement hydration stopper with water. The hydration stopper is acidic in a state of an aqueous solution. The amount of the hydration stopper is controlled such that the premixed material has a pH of 2 to 7. Immediately after adding and mixing an alumina cement hydration starter to the premixed material, the resultant mixture is cast into a mold. The addition of the hydration starter can be carried out 5 days or more after the production of the premixed material.