Premium
Psychometric Evaluation of a 13‐Point Measure of Students’ Overall Competence in Community‐Based Dental Education Programs
Author(s) -
Ramaswamy Vidya,
Piskorowski Wilhelm,
Fitzgerald Mark,
Hamerink Howard A.,
Stefanac Stephen,
Greene Rachel,
Lantz Marilyn S.
Publication year - 2016
Publication title -
journal of dental education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.53
H-Index - 68
eISSN - 1930-7837
pISSN - 0022-0337
DOI - 10.1002/j.0022-0337.2016.80.10.tb06207.x
Subject(s) - cohort , inter rater reliability , competence (human resources) , grading (engineering) , medicine , conscientiousness , internal consistency , psychology , clinical psychology , medical education , family medicine , psychometrics , rating scale , personality , big five personality traits , developmental psychology , social psychology , extraversion and introversion , civil engineering , engineering
Since 2006, the University of Michigan School of Dentistry has used a 13‐point measure of overall competence instrument to assess fourth‐year dental students’ end‐rotation performance at community clinics. The aim of this study was to assess the reliability and validity of this instrument used by preceptors to rate students’ overall competence during community‐based dental education experiences. The measure was analyzed using performance ratings for all fourth‐year DDS students in the graduating classes of 2012 and 2013 (combined n=201). The results were that interrater agreement was satisfactory and the measure scored high for internal consistency; also, the measure loaded highly on a single overall competence factor. Ratings on this measure did not correlate with students’ final cumulative dental school GPA, but showed a significant positive correlation with their fourth‐year fall patient management grades (which signify students’ conscientiousness in managing patients and their families in a professional and ethical manner). There were differences in grading systems between the 2012 cohort (which used a pass/fail system) and the 2013 cohort (which used a letter grade system) and the mean ratings they received (higher for the 2013 cohort). Overall, the study found that the 13‐point measure demonstrated excellent reliability and validity, suggesting it is useful in determining a student's clinical competence in these settings.