Open AccessShared Control of a Robot Arm Using BCI and Computer Vision
Author(s) -
Mohammed Qasim,
Omar Y. Ismael
Publication year - 2022
Publication title -
journal européen des systèmes automatisés/journal européen des systèmes automaitsés
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.16
H-Index - 20
eISSN - 2116-7087
pISSN - 1269-6935
DOI - 10.18280/jesa.550115
Subject(s) - brain–computer interface , grasp , teleoperation , computer science , interface (matter) , robot , computer vision , artificial intelligence , robotic arm , python (programming language) , robot control , simulation , human–computer interaction , mobile robot , psychology , electroencephalography , bubble , psychiatry , maximum bubble pressure method , parallel computing , programming language , operating system
Brain-Computer Interface (BCI) is a device that can transform human thoughts into control commands. However, BCI aggravates the common problems of robot teleoperation due to its low-dimensional and noisy control commands, particularly when utilized to control high-DOF robots. Thus, a shared control strategy can enhance the BCI performance and reduce the workload for humans. This paper presents a shared control scheme that assists disabled people to control a robotic arm through a non-invasive Brain-Computer Interface (BCI) for reach and grasp activities. A novel algorithm is presented which generates a trajectory (position and orientation) for the end-effector to reach and grasp an object based on a specially designed color-coded tag placed on the object. A single camera is used for tag detection. The simulation is performed using the CoppeliaSim robot simulator in conjunction with MATLAB to implement the tag detection algorithm and Python script to receive the commands from the BCI. The human-in-the-loop simulation results prove the effectiveness of the proposed algorithm to reach and grasp objects.