Premium
Web‐based Multisource Reference Checking: An investigation of psychometric integrity and applied benefits
Author(s) -
Hedricks Cynthia A.,
Robie Chet,
Oswald Frederick L.
Publication year - 2013
Publication title -
international journal of selection and assessment
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.812
H-Index - 61
eISSN - 1468-2389
pISSN - 0965-075X
DOI - 10.1111/ijsa.12020
Subject(s) - reliability (semiconductor) , psychology , consistency (knowledge bases) , applied psychology , task (project management) , reference data , internal consistency , personnel selection , web application , computer science , psychometrics , data mining , statistics , clinical psychology , artificial intelligence , world wide web , mathematics , physics , management , quantum mechanics , power (physics) , economics
Reference checking is a near‐universal practice within personnel selection systems, and legal pressures to gather job‐relevant and structured feedback from references is mounting. Despite this state of affairs, reference checking is a woefully under‐researched method for obtaining psychometrically sound and behaviorally informative data that predict task, team, and leadership behavior at work. From studies of job candidates in applied settings, this article reports on the reliability, validity, and compliance of multisource reference feedback gathered using a web‐based methodology. Acceptable levels of internal consistency, inter‐rater reliability, and test–retest reliability of the reference‐checking instrument were realized. Results of survival analyses found support for prediction of involuntary, but not voluntary turnover. No practically significant differences were found in overall mean scores across demographic subgroups. Finally, the web‐based reference‐checking system evinced high degrees of efficiencies across a range of metrics (e.g., reference response time, reference response rate, candidate response time).