Premium
An investigation of facilitator‐assisted and CONOPS‐based requirements elicitation methods using a 2 × 2 factorial experimental design
Author(s) -
Gambhir S. Gulu
Publication year - 2001
Publication title -
systems engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.474
H-Index - 50
eISSN - 1520-6858
pISSN - 1098-1241
DOI - 10.1002/sys.1023
Subject(s) - facilitator , scope (computer science) , computer science , systems engineering , reliability engineering , engineering , political science , law , programming language
System developments are frequently unsuccessful as measured in performance, cost, and schedule dimensions. Previous research has traced many development problems to poor system requirements. A method called Facilitator‐Assisted Requirements Elicitation (FARE), which employs a technical facilitator for discussion of requirements based on a Concept of Operations (CONOPS) Matrix, is developed and tested. A 2 × 2 factorial design was used to examine the effects of two independent variables on the FARE method: (1) facilitator presence or absence and (2) CONOPS Matrix or free‐form development. Twenty‐four subjects were randomly divided into four groups. Each group was given the task of developing a set of requirements and recording both a priority and rationale for the inclusion of each requirement. The three dependent variables are Communications, measured by responses to a post‐experiment survey; Requirements Scope, measured by subjective evaluation of requirements sets by an independent panel; and Requirements Quality, also measured by the independent panel. Results indicate a significant improvement in Communications when a facilitator was present. Requirements Scope showed a significant improvement when either a facilitator or the CONOPS Matrix was used, but was degraded when both elicitation techniques were used in combination. A significant improvement in Requirements Quality was observed when the groups were facilitated versus when they were not facilitated. Overall, both the presence of the facilitator and the use of the CONOPS Matrix showed benefits. Degradation in Requirements Scope, observed when both techniques were used in combination, is believed to be the result of the time constraints imposed on the subjects. The results of the experimentation support the use of FARE as an effective approach for capturing requirements early in the development lifecycle, thereby avoiding costly requirements changes. © 2001 John Wiley & Sons, Inc. Syst Eng 4: 272–286, 2001