Scenario and Scoring Sheet Development for Engineering Professional Skill Assessment

The Engineering Professional Skill Assessment (EPSA) was created as a direct method for eliciting and measuring ABET professional skills as described in criterion 3 student outcomes. EPSA is a performance assessment consisting of: 1) a 1-2 page scenario about a contemporary, interdisciplinary engineering problem intended to prompt discussion among a group of 5-6 students; 2) a 45minute discussion period where students are asked to address a series of generic questions about the scenario; 3) an analytical rubric; and 4) a set of scenario-specific notes about what constitutes exemplary performance. This method and assessment tool can be used at the course level for developing engineering professional skills and providing feedback, as well as at the program level for data collection and accreditation reporting purposes. The EPSA project is currently in the third year of a four year National Science Foundation sponsored validity study. This paper outlines best practices and provides an assessment tool for crafting timely, relevant, and engaging scenarios. This paper also includes a score sheet that can be used to provide realtime feedback to students immediately following a group discussion. The current version of the analytic rubric used for rating audio transcripts for program-level assessment purposes is provided as well. These practices and tools are illustrated in conjunction with a sample scenario about modern challenges in managing electronic waste. Feedback from project advisory board members are integrated in this discussion.