Open AccessAdvanced UI test automation (AUTA) for BIOS validation using OpenCV and OCR
Author(s) -
Eissa Abdullah Awadh Mohammed,
Muslim Mustapa,
Hasliza A. Rahim,
Mohd Natashah Norizan
Publication year - 2021
Publication title -
indonesian journal of electrical engineering and computer science
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.241
H-Index - 17
eISSN - 2502-4760
pISSN - 2502-4752
DOI - 10.11591/ijeecs.v23.i3.pp1350-1356
Subject(s) - automation , interface (matter) , computer science , embedded system , bios , computer hardware , graphical user interface , test (biology) , system under test , graphical user interface testing , device under test , user interface , operating system , test case , engineering , user interface design , machine learning , biology , mechanical engineering , paleontology , regression analysis , bubble , maximum bubble pressure method , telecommunications , microwave
Basic input output system (BIOS) validation is performed on both graphical user interface (GUI) and command-line interface (CLI) by a test engineer. Keyboard and mouse are used to insert test cases commands into system under test (SUT). Test engineer monitors test cases progress on a monitor for validation. This method is time-consuming and relatively more expensive than automation. In this project we designed an independent automation system that able to mimic human interaction in BIOS validation. The approach can be divided into two main parts. The first part is the input device to enter commands into SUT and the second part is the advanced image recognizer. The keyboard and mouse emulator is used as an input device to reproduce test commands and send them to an SUT. The image analyzer algorithm is developed using OpenCV and optical character recognizer (OCR) tools to help automate some test challenges. Our result shows that advanced user interface (UI) test automation (AUTA) can perform a 125 test cases within 5 hours compared to 48 hours for a human to complete the job.