Open AccessAutomatic Caption Generation from Images Based on Facial Emotions
Author(s) -
G. Priyanka,
T. Revathi,
K. Muneeswaran
Publication year - 2020
Publication title -
international journal of recent technology and engineering
Language(s) - English
Resource type - Journals
ISSN - 2277-3878
DOI - 10.35940/ijrte.d1038.1284s519
Subject(s) - computer science , upload , convolutional neural network , artificial intelligence , face (sociological concept) , facial expression , process (computing) , emotion recognition , computer vision , emotion classification , image (mathematics) , pattern recognition (psychology) , world wide web , social science , sociology , operating system
In the current era, the vast number of internet users accesses the social network sites like Facebook, Whatsapp, Twitter, and Instagram for uploading their images. User may upload all kind of images with different emotions. In this research article, we introduce novel facial emotion recognition technique using Convolutional Neural Network (CNN) approach and associated a caption automatically based on the identified emotion. We consider only still images for emotion classification. Using face detection algorithms faces were detected from the facial image which is followed by emotion prediction. We automated this detection process for images having frontal faces. In images having non-frontal faces, we manually plot the eye points for rotating the face in such a way that algorithm can detect faces easily. Inferences obtained as a result of experiments shows that the proposed work is capable of identifying minute differences between different emotions and predict accordingly. Based on the emotions identified corresponding captions are generated with better accuracy.