Open AccessResearch and Discovery of Smart Dumb Gloves
Author(s) -
Xixun Yu,
Suying Liu,
Weiyi Fang,
Zhang Yan-kun
Publication year - 2021
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/1865/4/042054
Subject(s) - sign language , bluetooth , stm32 , computer science , gesture , microcontroller , mobile phone , gesture recognition , voice command device , software , phone , human–computer interaction , wireless , speech recognition , embedded system , artificial intelligence , telecommunications , operating system , philosophy , linguistics , chip
According to the statistics of China’s health organization, there are a large number of deaf-mute people in the whole country. Sign language is used to communicate between deaf and dumb people. When they communicate with people who don’t know sign language, it will bring a lot of inconvenience. Based on the above problems, we propose a sign language gesture recognition system based on data glove. The overall architecture is composed of stnm32 MCU, flex4.5 bending sensor, mpu6050 six axis sensor, Bluetooth transmission module and mobile phone voice app. It collects the user’s hand movement information through flex4.5 bending sensor and mpu6050 six axis sensor, Then the STM32 microcontroller processes the data and compares it with the action data in the database. Then the action voice command is sent to the mobile phone through the Bluetooth transmission module, and finally the voice playback and text display are carried out through the mobile phone app. The software of sign language gesture recognition system is developed by using processing software based on Java language, which is connected with it to complete the recognition of sign language actions, and then output the words to be said through the intelligent voice system.