Premium
Psychometric Properties of Raw and Scale Scores on Mixed‐Format Tests
Author(s) -
Kolen Michael J.,
Lee WonChan
Publication year - 2011
Publication title -
educational measurement: issues and practice
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.158
H-Index - 52
eISSN - 1745-3992
pISSN - 0731-1745
DOI - 10.1111/j.1745-3992.2011.00201.x
Subject(s) - equating , raw score , reliability (semiconductor) , psychometrics , item response theory , scale (ratio) , psychology , statistics , raw data , clinical psychology , computer science , mathematics , applied psychology , econometrics , rasch model , geography , power (physics) , physics , quantum mechanics , cartography
This paper illustrates that the psychometric properties of scores and scales that are used with mixed‐format educational tests can impact the use and interpretation of the scores that are reported to examinees. Psychometric properties that include reliability and conditional standard errors of measurement are considered in this paper. The focus is on mixed‐format tests in situations for which raw scores are integer‐weighted sums of item scores. Four associated real‐data examples include (a) effects of weights associated with each item type on reliability, (b) comparison of psychometric properties of different scale scores, (c) evaluation of the equity property of equating, and (d) comparison of the use of unidimensional and multidimensional procedures for evaluating psychometric properties. Throughout the paper, and especially in the conclusion section, the examples are related to issues associated with test interpretation and test use.