Open AccessDETECTING CONSTRUCT‐IRRELEVANT VARIANCE IN AN OPEN‐ENDED, COMPUTERIZED MATHEMATICS TASK
Author(s) -
Gallagher Ann,
Bennett Randy Elliot,
Cahalan Cara
Publication year - 2000
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2000.tb01841.x
Subject(s) - pencil (optics) , variance (accounting) , construct (python library) , computer science , construct validity , test (biology) , expression (computer science) , task (project management) , heuristics , mathematics education , statistics , mathematics , psychometrics , mechanical engineering , paleontology , operating system , accounting , management , economics , engineering , business , biology , programming language
ABSTRACT The purpose of this study was to evaluate whether variance due to computer‐based presentation was associated with performance on a new constructed‐response type — Mathematical Expression — that requires examinees to build mathematical expressions using a mouse and an on‐screen tool palette. Participants took parallel computer‐based and paper‐based tests consisting of Mathematical Expression items, plus a test of their skill in entering and editing data using the computer interface. Comparisons of mean performance, reliability, speededness, and relations with external indicators were conducted across the paper‐based and computer‐based tests; also, computer‐based math score was regressed on edit/entry score after controlling for paper‐and‐pencil math score and background information. Although no statistical evidence of construct‐irrelevant variance was detected, some examinees reported mechanical difficulties in responding and indicated a preference for the paper‐and‐pencil test.