Open AccessImage Caption Generation Model Based on Object Detector
Author(s) -
Aghasi S. Poghosyan,
Hakob G. Sarukhanyan
Publication year - 2018
Publication title -
mathematical problems of computer science
Language(s) - English
Resource type - Journals
eISSN - 2738-2788
pISSN - 2579-2784
DOI - 10.51408/1963-0016
Subject(s) - computer science , generator (circuit theory) , artificial intelligence , computer vision , object (grammar) , image (mathematics) , object detection , detector , task (project management) , pattern recognition (psychology) , engineering , power (physics) , telecommunications , physics , systems engineering , quantum mechanics
Automated semantic information extraction from the image is a difficult task. There are works, which can extract image caption or object names and their coordinates. This work presents object detection and automated caption generation implemented via a single model. We have built an image caption generation model on top of object detection model. We have added extra layers on object detector to increase caption generator performance. We have developed a single model that can detect objects, localize them and generate image caption via natural language.