Premium
Validating Dental and Medical Students’ Evaluations of Faculty Teaching in an Integrated, Multi‐Instructor Course
Author(s) -
Stratton Terry D.,
Witzke Donald B.,
Freund Mary Jane,
Wilson Martha T.,
Jacob Robert J.
Publication year - 2005
Publication title -
journal of dental education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.53
H-Index - 68
eISSN - 1930-7837
pISSN - 0022-0337
DOI - 10.1002/j.0022-0337.2005.69.6.tb03949.x
Subject(s) - course (navigation) , medical education , course evaluation , higher education , psychology , medicine , mathematics education , engineering , political science , law , aerospace engineering
Abstract As more students from various health professions are combined into integrated courses, evaluating the teaching quality of individual faculty in these typically large, multi‐instructor contexts becomes increasingly difficult. Indeed, students who lack sufficient recall of a given faculty member or are not committed to the evaluation process may respond by marking identical responses to all evaluation items (e.g., 3‐3‐3‐3‐3), regardless of the specific content of the items on the faculty evaluation questionnaire. These “straight‐lining” behaviors—more formally referred to as monotonic response patterns (MRPs)—often reflect students’ inattention to the task at hand or lack of motivation to be discriminating, which may result in invalid data. This study examines the prevalence of MRP ratings in relation to indicators reflective of students’ lack of attention to evaluating the quality of faculty teaching. Dental and medical students in a required, second‐year (medicine) basic science course conducted by the medical school and taught primarily by medical school faculty completed seven‐item faculty evaluation forms, along with an anonymous questionnaire measuring their need to evaluate, attitudes toward faculty evaluation, and recall of instructors. MRP ratings failed to correlate significantly with students’ need to evaluate or their attitudes toward faculty evaluation. However, among medical students, MRP “straight‐line” responses were more prevalent for raters who recalled faculty members “very well” ( p =.04). For dental students, MRPs were associated with less accurate recall ( p =.01). As such, the validity of faculty evaluations within integrated, multi‐instructor courses may vary when students rate distinct aspects of a teacher's performance identically. In this case—in which medical students’ greater recall of instructors coincides with MRPs—ratings may suffice as global, holistic assessments of an instructor's teaching. For dental students, similar ratings may be less viable. Individual item analysis is cautioned under any circumstances.