Open AccessA Dynamic Hand Gesture Recognition Algorithm Based on CSI and YOLOv3
Author(s) -
Qiang Zhang,
Yong Zhang,
Zhiguo Liu
Publication year - 2019
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/1267/1/012055
Subject(s) - gesture , computer science , artificial intelligence , gesture recognition , computer vision , confusion matrix , convolutional neural network , segmentation , kalman filter , pattern recognition (psychology) , speech recognition
Object detection algorithms based on convolutional neural networks are generally suitable for static gesture recognition. For actual hand gesture scenes, dynamic gestures are also widely used. A dynamic hand gesture recognition algorithm based on Channel State Information (CSI) and You Only Look Once: Version 3 (YOLOv3) is proposed for continuous dynamic hand gesture recognition. The data acquisition adopts a CSI-based radio frequency method. The adaptive weighted fusion, Kalman filtering, threshold segmentation and data conversion are used to generate gray value images. Finally, the YOLOv3 object detection algorithm is used to train and identify the grayscale image which include the information of continuous dynamic hand gestures. The effectiveness of the proposed method is verified by the recognition confusion matrix. And the proposed method has an average recognition accuracy of 94% for four custom dynamic hand gestures.