Open AccessCOMPARING THE INCOMPARABLE: AN ESSAY ON THE IMPORTANCE OF BIG ASSUMPTIONS AND SCANT EVIDENCE
Author(s) -
Wainer Howard
Publication year - 1999
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.1999.tb01823.x
Subject(s) - ceteris paribus , equity (law) , psychology , positive economics , politics , econometrics , epistemology , statistical hypothesis testing , economics , statistics , mathematics , law , political science , philosophy
Comparisons between groups usually involve making statistical adjustments so that the comparisons are, statistically speaking, ceteris paribus. Usually included within those adjustments are some untestable assumptions. These untestable assumptions are often determined by the goals of the testing program; they are sometimes justified on the basis of theory, sometimes on the basis of political expediency, and sometimes on just a hope and a prayer. If we are vigilant, bits of evidence may emerge from the data that can corroborate or refute our assumptions. In this essay I describe several examples, drawn from mental testing, that illustrate these issues, and suggest a plausible path of investigation that may provide a better estimate of the practical limitations of accuracy for any proposed solution to this vexing equity issue.