Open AccessMulti-label Image Classification Model via Label Correlation Matrix
Author(s) -
Tong Huang,
Dongdong Wu,
Guiduo Duan,
Hao Huang
Publication year - 2022
Publication title -
journal of physics. conference series
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.21
H-Index - 85
eISSN - 1742-6596
pISSN - 1742-6588
DOI - 10.1088/1742-6596/2216/1/012107
Subject(s) - computer science , artificial intelligence , pattern recognition (psychology) , correlation , multi label classification , image (mathematics) , feature (linguistics) , contextual image classification , set (abstract data type) , data mining , machine learning , mathematics , linguistics , philosophy , geometry , programming language
Multi-label classification is one of the most essential tasks of computer vision. In the multi-label image classification model, using the correlation between labels is a powerful method for improving the classification effectiveness of the model. However, common methods ignore the interrelationship between the label pairs. On the other hand, introducing a spatial attention mechanism into the model could also improve the classification effectiveness of the model. However, most methods that use the attention mechanism module do not use the correlation information between labels. To solve these issues, we propose a novel multi-label image classification model using the label correlation in the paper. Our model generates label word vectors based on the BERT model that can describe the potential relationship between labels. And then we combine these vectors with static statistics information on labels to construct a new label correlation matrix. Moreover, we introduce label semantic information into the spatial attention mechanism. With the semantic information, the generated spatial attention map could focus on the image feature regions with label correlation, and complete the accurate classification of the model. On the Microsoft COCO data set, this model achieves the best score of 84.3% on mAP, which shows the effectiveness of our model.