Open AccessVirtual robot arm controlled by hand gestures via Leap Motion Sensor
Author(s) -
Oana Andreea Rușanu,
Luciana Cristea,
Marius Cristian Luculescu,
Petru Adrian Cotfas,
Daniel Tudor Cotfas
Publication year - 2019
Publication title -
iop conference series. materials science and engineering
Language(s) - English
Resource type - Journals
eISSN - 1757-899X
pISSN - 1757-8981
DOI - 10.1088/1757-899x/514/1/012021
Subject(s) - gesture , computer science , swipe , robot , robotic arm , controller (irrigation) , rotation (mathematics) , virtual reality , accelerometer , artificial intelligence , translation (biology) , computer vision , gesture recognition , simulation , human–computer interaction , computer network , biochemistry , chemistry , messenger rna , gene , agronomy , biology , operating system
This paper proposes a LabVIEW instrument aimed to design and control a 3D virtual robot arm using hand gestures translated into commands with the help of Leap Motion Controller. In order to acquire signals and translate them into basic swipe gesture commands, a LabVIEW toolkit was used. The application is useful for providing assistance for people with disabilities who cannot move or lack strong muscle strength. They can use the virtual simulation for training purpose in order to achieve the ability to control a real robot arm. Moreover, they have a visual feedback that sustains and adjusts their movements. The 3D model is a robot arm placed on a flat surface. Translation along two perpendicular directions in the base plan is allowed and also the rotation of its joints. The virtual robot arm can provide several benefits regarding moving to a target, grasping it and bringing it to the patient.