Premium
Evaluating testing effectiveness during software evolution: a time‐series cross‐section approach
Author(s) -
Hale Joanne E.,
Hale David P.
Publication year - 2012
Publication title -
journal of software: evolution and process
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.371
H-Index - 29
eISSN - 2047-7481
pISSN - 2047-7473
DOI - 10.1002/smr.531
Subject(s) - capability maturity model integration , computer science , identification (biology) , software , regression testing , data mining , software engineering , software development , reliability engineering , software development process , engineering , software construction , botany , biology , programming language
SUMMARY As software evolution organizations (SEOs) formalize their activities into standard repeatable processes, capability maturity models suggest that they gather and analyze data to quantitatively manage their activities. This study examines the use of a time‐series cross‐section (TSCS) modeling approach to inform the quantitative management of the testing activities within a mature SEO. This paper describes the TSCS modeling approach and provides an exemplar case study that details its use. Data for the case study come from readily available, commonly gathered production and testing defect reports in the quantitative measurement efforts of ait CMMI‐DEV Level 3 assessed software development and evolution organization. Covering six independent projects for 43 months, the case study defines quality in terms of reported defects in the production code base. The predictors are the six projects and defect data identified in the unit, system, and regression testing activities logs. The case study also details how results from the TSCS analysis triggered causal analysis to improve the testing activities. The study provides evidence that TSCS models can be used as a quantitative problem identification tool for the mature ( SM mm Level 3 or higher) SEO's testing activities. Copyright © 2011 John Wiley & Sons, Ltd.