Premium
Understanding the effects of changes on the cost‐effectiveness of regression testing techniques
Author(s) -
Elbaum Sebastian,
Kallakuri Praveen,
Malishevsky Alexey,
Rothermel Gregg,
Kanduri Satya
Publication year - 2003
Publication title -
software testing, verification and reliability
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.216
H-Index - 49
eISSN - 1099-1689
pISSN - 0960-0833
DOI - 10.1002/stvr.263
Subject(s) - regression testing , risk based testing , computer science , non regression testing , regression analysis , regression , variance (accounting) , test management approach , test strategy , reliability engineering , manual testing , software , machine learning , statistics , engineering , software system , software construction , mathematics , accounting , business , programming language
Regression testing is an expensive testing process used to validate modified software. Regression test selection and test‐case prioritization can reduce the costs of regression testing by selecting a subset of test cases for execution, or scheduling test cases to meet testing objectives better. The cost‐effectiveness of these techniques can vary widely, however, and one cause of this variance is the type and magnitude of changes made in producing a new software version. Engineers unaware of the causes and effects of this variance can make poor choices in designing change integration processes, selecting inappropriate regression testing techniques, designing excessively expensive regression test suites and making unnecessarily costly changes. Engineers aware of causal factors can perform regression testing more cost‐effectively. This article reports the results of an embedded multiple case study investigating the modifications made in the evolution of four software systems and their impact on regression testing techniques. The results of this study expose tradeoffs and constraints that affect the success of techniques and provide guidelines for designing and managing regression testing processes. Copyright © 2003 John Wiley & Sons, Ltd.