How Accurate Is Students’ Self Assessment Of Computer Skills?

Self-evaluation by students is commonly used as a key element in program and course assessment plans. Such instruments are intended to provide crucial feedback for program improvement and thus play a significant role in closing our assessment loop. For many of the program outcomes, self-assessment by current students and graduates augments other, more objective measures. However, for some outcomes there are no practical means of obtaining objective assessment and we must rely on self-assessment. The heavy reliance on this metric begs the question “How accurate is student self-assessment?” This paper provides data from a second-semester engineering course in which students develop proficiency using computer tools to solve typical engineering problems. Students’ self-assessments in several areas are compared with the instructor’s assessment of these students. Some work reported in the literature addresses the accuracy of student self-assessment in specific academic areas. In the medical field, literature exists which addresses medical students’ selfassessment of specific skills. Other comparisons have been published to compare students’ expected grades with actual results. Little was found that is relevant to engineering student and in particular to their assessment of professional skills. The work reported here relates to the assessment of ABET’s program outcome k: “an ability to use the techniques, skills and modern engineering tools necessary for engineering practice. Methods of Engineering Analysis is a course taken by all engineering majors during their second semester at the University of New Haven. In this course, students are introduced to engineering topics and a variety of numerical methods for solving these problems. The current platform used is a spreadsheet with Visual Basic for Applications programming. Students complete a 30question survey the first day of class in which they rate their expertise in three broad categories: basic spread-sheet usage, advanced spread-sheet usage and programming. The same survey is completed at the end of the class, thus providing a pre and post view from the students perspective. Quizzes given throughout the course and the final exam were structured to enable instructors to assess student performance in these same areas with composite measures. Data is presented to compare the instructor assessment of performance with students’ self-assessment at the individual level.