Conversation Engine for Deaf and Dumb

There are a lot of people who have many disabilities in our world out of which,people whoare deaf and dumb cannot convey there messages to the normal people. Conversation becomes verydifficult for this people. Deaf people cannot understand and hear what normal people is going to convey,similarly dumb people need to convey their message using sign languages where normal people cannotunderstand unless he/she knows or understands the sign language. This brings to a need of an applicationwhich can be useful for having conversation between deaf,dumb and normal people. Here we are usinghand gestures of Indian sign language (ISL) which contain all the alphabets and 0-9 digit gestures. Thedataset of alphabets and digits is created by us.After dataset building we extracted the features using bagof-words and image preprocessing.With the feature extraction, histograms are been generated which mapsalphabets to images. Finally, these features are fed to the supervised machine learning model to predictthe gesture/sign. We did also use CNN model for training the model.