Premium
Opportunities for Gaming the System: How Data Collection Design Influences Program Assessment Outcomes
Author(s) -
Collins Jasmine D.,
Rosch David M.,
Stephens Clinton M.
Publication year - 2018
Publication title -
journal of leadership studies
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.219
H-Index - 14
eISSN - 1935-262X
pISSN - 1935-2611
DOI - 10.1002/jls.21581
Subject(s) - data collection , curriculum , work (physics) , psychology , research design , medical education , computer science , public relations , political science , sociology , pedagogy , engineering , medicine , mechanical engineering , social science
Opportunities for college students to develop their leadership capacity through participation in formal leadership programs have grown tremendously. As the assessment of such programs rises, educators must become knowledgeable about the potentially significant design effects on assessment results. Using a national leadership program as a case study, we quasi‐experimentally examined the effects of data collection design on measured outcomes, and discovered surprisingly noteworthy differences in results. Our work suggests that collection design may be even more important to whether leadership programs seem to make a difference than the curriculum itself.