Premium
APPLICATION OF CONTENT VALIDITY METHODS TO THE DEVELOPMENT OF A JOB‐RELATED PERFORMANCE RATING CRITERION
Author(s) -
DISTEFANO M. K.,
PRYER MARGARET W.,
ERFFMEYER ROBERT C.
Publication year - 1983
Publication title -
personnel psychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 6.076
H-Index - 142
eISSN - 1744-6570
pISSN - 0031-5826
DOI - 10.1111/j.1744-6570.1983.tb02239.x
Subject(s) - psychology , rating scale , content validity , criterion validity , test validity , selection (genetic algorithm) , scale (ratio) , applied psychology , sample (material) , personnel selection , job performance , clinical psychology , psychometrics , social psychology , statistics , job satisfaction , construct validity , developmental psychology , computer science , artificial intelligence , mathematics , chemistry , physics , chromatography , quantum mechanics
This study demonstrated the use of quantitative content validity procedures in the development of a job‐related behavioral rating scale criterion for entry‐level psychiatric aides. Work behavior items were developed by staff from 6 state psychiatric hospitals, placed in a content validity questionnaire using the Lawshe format, and given to a representative sample of 38 aides and supervisors. Seventy‐eight of 83 items were found to be significantly job‐relevant using the computation procedures of both Lawshe and Aiken. After the significant items were grouped into 4 categories with high interjudge agreement and placed in a rating scale format, ratings were obtained on 72 psychiatric aides from 4 hospitals. Items in the 4 categories were found to be internally consistent using coefficient alpha. Significant but low concurrent validities were established for 2 verbal ability selection tests using the rating criterion. The validities found were interpreted to be especially significant when the factors of low selection ratio, restriction in range, and limited rater training were considered.