Open AccessAndroid based application for visually impaired using deep learning approach
Author(s) -
Haslinah Mohd Nasir,
Noor Mohd Ariff Brahin,
Mai Mariam Mohamed Aminuddin,
Mohd Syafiq Mispan,
Mohd Faizal Zulkifli
Publication year - 2021
Publication title -
iaes international journal of artificial intelligence
Language(s) - English
Resource type - Journals
eISSN - 2252-8938
pISSN - 2089-4872
DOI - 10.11591/ijai.v10.i4.pp879-888
Subject(s) - computer science , visually impaired , android (operating system) , artificial intelligence , convolutional neural network , deep learning , cognitive neuroscience of visual object recognition , mobile device , computer vision , classifier (uml) , machine learning , human–computer interaction , feature extraction , world wide web , operating system
People with visually impaired had difficulties in doing activities related to environment, social and technology. Furthermore, they are having issues with independent and safe in their daily routine. This research propose deep learning based visual object recognition model to help the visually impaired people in their daily basis using the android application platform. This research is mainly focused on the recognition of the money, cloth and other basic things to make their life easier. The convolution neural network (CNN) based visual recognition model by TensorFlow object application programming interface (API) that used single shot detector (SSD) with a pre-trained model from Mobile V2 is developed at Google dataset. Visually impaired persons capture the image and will be compared with the preloaded image dataset for dataset recognition. The verbal message with the name of the image will let the blind used know the captured image. The object recognition achieved high accuracy and can be used without using internet connection. The visually impaired specifically are largely benefited by this research.