Premium
A Real‐time Continuous Alphabetic Sign Language to Speech Conversion VR System
Author(s) -
Liang RungHuei,
Ouhyoung Ming
Publication year - 1995
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/j.1467-8659.1995.cgf143_0067.x
Subject(s) - computer science , gesture , gesture recognition , sign language , wired glove , speech recognition , american sign language , point (geometry) , human–computer interaction , artificial intelligence , philosophy , linguistics , geometry , mathematics
Many ways of communications are used between human and computer, while using gesture is considered to be one of the most natural way in a virtual reality system. Because of its intuitiveness and its capability of helping the hearing impaired or speaking impaired, we develop a gesture recognition system. Considering the world‐wide use of ASL (American Sign Language), this system focuses on the recognition of a continuous flow of alphabets in ASL to spell a word followed by the speech synthesis, and adopts a simple and efficient windowed template matching recognition strategy to achieve the goal of a real‐time and continuous recognition. In addition to the abduction and the flex information in a gesture, we introduce a concept of contact‐point into our system to solve the intrinsic ambiguities of some gestures in ASL. Five tact switches, served as contact‐points and sensed by an analogue to digital board, are sewn on a glove cover to enhance the functions of a traditional data glove.