Premium
Process mining based approach to performance evaluation in computer‐aided examinations
Author(s) -
Baykasoğlu Adil,
Özbel Burcu K.,
Dudaklı Nurhan,
Subulan Kemal,
Şenol Mümin Emre
Publication year - 2018
Publication title -
computer applications in engineering education
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.478
H-Index - 29
eISSN - 1099-0542
pISSN - 1061-3773
DOI - 10.1002/cae.21971
Subject(s) - computer science , process (computing) , similarity (geometry) , computer aided , process mining , data mining , resource (disambiguation) , data science , machine learning , software engineering , artificial intelligence , work in process , engineering , programming language , computer network , operations management , business process modeling , image (mathematics) , business process , operating system
A considerable part of educational systems tends to be online and computer oriented. However, online examination may create some difficulties during the evaluation of student performance. Process mining which arises as a new concept presents various powerful techniques for processing and analyzing different types of data by making use of some advanced information technologies. This paper proposes a novel approach based on process mining for evaluating the performance of students that should follow certain tasks on the computer. The proposed approach is composed of two main phases which are process mining and similarity analysis. Automatic assessment is performed totally in six steps in order to obtain students’ final grades. In addition, cheat control is possible in the last step thanks to the similarity analysis. A real‐life application in an Enterprise Resource Planning (ERP) course is performed in order to present usefulness, validity and practicality of the proposed approach. Furthermore, to evaluate the performance of the assessment system, we compared the assessment mechanism against instructor. A total of 15 students’ answers belonging to computer‐aided exam are assessed by instructor and the results showed a very good agreement between the automatic assessment system and instructor.