Open AccessAnalysis of the Fuzziness of Image Caption Generation Models due to Data Augmentation Techniques
Author(s) -
Kota Akshith Reddy,
Chemudu Satish,
Jahnavi Polsani,
Teja Naveen Chintapalli,
Gangapatnam Sai Ananya
Publication year - 2021
Publication title -
international journal of recent technology and engineering
Language(s) - English
Resource type - Journals
ISSN - 2277-3878
DOI - 10.35940/ijrte.c6439.0910321
Subject(s) - closed captioning , computer science , robustness (evolution) , artificial intelligence , zoom , image (mathematics) , computer vision , pattern recognition (psychology) , biochemistry , chemistry , petroleum engineering , engineering , gene , lens (geology)
Automatic Image Caption Generation is one of the core problems in the field of Deep Learning. Data Augmentation is a technique which helps in increasing the amount of data at hand and this is done by augmenting the training data using various techniques like flipping, rotating, Zooming, Brightening, etc. In this work, we create an Image Captioning model and check its robustness on all the major types of Image Augmentation techniques. The results show the fuzziness of the model while working with the same image but a different augmentation technique and because of this, a different caption is produced every time a different data augmentation technique is employed. We also show the change in the performance of the model after applying these augmentation techniques. Flickr8k dataset is used for this study along with BLEU score as the evaluation metric for the image captioning model.