Open AccessRASCH RATING SCALE MODELING OF DATA FROM THE STANDARDIZED LETTER OF RECOMMENDATION
Author(s) -
Kim Sooyeon,
Kyllonen Patrick C.
Publication year - 2006
Publication title -
ets research report series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.235
H-Index - 5
ISSN - 2330-8516
DOI - 10.1002/j.2333-8504.2006.tb02038.x
Subject(s) - rasch model , likert scale , rating scale , psychology , item response theory , scale (ratio) , psychometrics , reliability (semiconductor) , item analysis , clinical psychology , developmental psychology , power (physics) , physics , quantum mechanics
The Standardized Letter of Recommendation (SLR), a 28‐item form, was created by ETS to supplement the qualitative rating of graduate school applicants' nonacademic qualities with a quantitative approach. The purpose of this study was to evaluate the following psychometric properties of the SLR using the Rasch rating‐scale model: dimensionality, reliability, item quality, and rating category effectiveness. Principal component and factor analyses were also conducted to examine the dimensionality of the SLR. Results revealed (a) two secondary factors underlay the data, along with a strong higher order factor, (b) item and person separation reliabilities were high, (c) noncognitive items tended to elicit higher endorsements than did cognitive items, and (d) a 5‐point Likert scale functioned effectively. The psychometric properties of the SLR support the use of a composite score when reporting SLR scores and the utility of the SLR in higher education and in admissions.