Systems and methods are disclosed for providing software performance testing. The results of a test may be determined valid if the test reached a defined test criteria after performing N number of iterations. If the test has not reached the defined test criteria and if N is less than a maximum value, one may be added to N and additional iteration of the test may be performed until the test reaches the defined test criteria or until N reaches the maximum value. If the test reaches the defined test criteria after any additional iteration of the test before N reaches the maximum value, the results of the test may be deemed valid. Moreover, if the test reached the defined test criteria with an outlier removed from the results, the results of the test may be deemed valid. Otherwise, the results of the test may be deemed invalid.