Open AccessRELEVANCE OF RATER‐RATEE ACQUAINTANCE IN THE VALIDITY AND RELIABILITY OF RATINGS 1
Author(s) -
Freeberg Norman E.
Publication year - 1967
Publication title -
ets research bulletin series
Language(s) - English
Resource type - Journals
eISSN - 2333-8504
pISSN - 0424-6144
DOI - 10.1002/j.2333-8504.1967.tb00994.x
Subject(s) - psychology , reliability (semiconductor) , cognition , relevance (law) , criterion validity , cognitive psychology , validity , test validity , concurrent validity , social psychology , psychometrics , developmental psychology , construct validity , power (physics) , physics , quantum mechanics , neuroscience , political science , law , internal consistency
Unacquainted S s worked in three‐man groups under relevant (mathematical tasks) and irrelevant (socializing) acquaintance conditions. The S s rated one another on scales that defined several cognitive skills. They were also rated on these same scales by observers who were dependent on visual information, exclusively, and were unacquainted with the group members or the specific nature of the tasks being performed. As hypothesized, group members under the relevant acquaintance condition achieved consistently good validity for all three cognitive areas—with the best validity for ratings of math ability. Validity under the irrelevant acquaintance condition was nil on all scales. Observers, surprisingly, achieved significant validity (although at lower levels than participating group members) for ratings under the relevant acquaintance condition. Levels of inter‐ and intrarater reliability were not associated with levels of validity under the various rating conditions.