Stopping Criteria for Regression Testing in GUI Application using Failure Intensity and Failure Reliability

We propose some criteria for GUI regression testing to determine the appropriate time to stop without wasting too much testing cost. This is essential for all software upgrades that can be released in a reasonably short time, yet still guarantees the product quality. One difficulty to achieve such a target depends on the sequence of test cases being input. The order affects the number of found failures. As such, the proposed methodology randomizes the order of test cases into different sequences for the regression test input. When a failure is found, it is edited immediately before the test resumes. Performance of the proposed criteria encompasses three measures, namely, failure intensity, cost of testing and editing, and reliability. The reliability function incorporates Weibull distribution to better reflect the test data. The proposed methodology is tested using real GUI applications as test data and shows satisfactory results on stopping criteria.