Systems and methods for estimating a time to cool down or warm up a building zone from a temperature setback condition are provided. A described method includes determining, by a controller for the building zone, at least one of a cooling demand for the building zone and a heating demand for the building zone for a time period corresponding to the temperature setback condition. The method further includes estimating a return time using at least one of the cooling demand and the heating demand. The return time is the time to cool down or warm up the building zone from the temperature setback condition.