Premium
Avoiding split attention in computer‐based testing: Is neglecting additional information facilitative?
Author(s) -
Jarodzka Halszka,
Janssen Noortje,
Kirschner Paul A.,
Erkens Gijsbert
Publication year - 2015
Publication title -
british journal of educational technology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.79
H-Index - 95
eISSN - 1467-8535
pISSN - 0007-1013
DOI - 10.1111/bjet.12174
Subject(s) - computer science , think aloud protocol , cognition , eye tracking , pencil (optics) , protocol analysis , mental effort , component (thermodynamics) , mental model , cognitive psychology , mental arithmetic , human–computer interaction , psychology , multimedia , applied psychology , artificial intelligence , cognitive science , mechanical engineering , physics , usability , neuroscience , engineering , thermodynamics , medicine , heart rate , radiology , blood pressure
This study investigated whether design guidelines for computer‐based learning can be applied to computer‐based testing (CBT). Twenty‐two students completed a CBT exam with half of the questions presented in a split‐screen format that was analogous to the original paper‐and‐pencil version and half in an integrated format. Results show that students attended to all information in the integrated format while ignoring information in the split format. Interestingly, and contrary to expectations, they worked more efficiently in the split format. A content analysis of the ignored information revealed that it was mostly not relevant to answering the questions, unnecessarily taxed students' cognitive capacity and inefficiently increased the mental effort they expended. Further comparisons of different mental effort measures indicate that mental effort had an explicit (ie, self‐reports, explicit utterances) and an implicit component (ie, silent pauses in thinking‐aloud, eye tracking parameters). Consequently, when designing CBT environments, not only the design of the tasks but also the content of the given information and their effect on the different aspects of mental effort must be considered.