Premium
Automatic traditional Chinese painting classification: A benchmarking analysis
Author(s) -
Liong SzeTeng,
Huang YenChang,
Li Shumeng,
Huang Zhongkai,
Ma Jingyang,
Gan Yee Siang
Publication year - 2020
Publication title -
computational intelligence
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.353
H-Index - 52
eISSN - 1467-8640
pISSN - 0824-7935
DOI - 10.1111/coin.12328
Subject(s) - benchmarking , computer science , artificial intelligence , deep learning , digitization , inpainting , field (mathematics) , salient , pattern recognition (psychology) , image processing , contextual image classification , artificial neural network , domain (mathematical analysis) , machine learning , image (mathematics) , computer vision , mathematics , marketing , business , mathematical analysis , pure mathematics
Summary In the recent years, there is a growing trend toward digitization of cultural heritage for better accessibility and preservation. For instance, the development of image processing techniques in traditional Chinese painting (TCP) has begun to attract researchers' attention in the computer vision field. TCP is one of the representative of Chinese traditional arts. Evidenced by the successes of development in image processing techniques in various applications, this article aim to apply the deep learning approach on TCP for several purposes, which include automatic establishment of unified image library, facilitating update‐to‐date data in the database, reduction of cost required for image classification and retrieval. First, a unified database is established, that consists of more than a thousand of images from six major TCP themes. Then, several deep learning algorithms that are based on mathematical models are applied to examine the classification performance. In addition, the salient regions that denote significant features are identified, by adopting the instance segmentation technique. As a result, the modified pretrained neural network is capable to achieve 99.66% recognition accuracy. Qualitative results are also presented to demonstrate the effectiveness of the proposed method. We also note that this is the first work that performs multiclass classification on six categories in this domain. Furthermore, a 10‐class classification result of 96% is obtained when performing on one of the painting types, namely, ghost‐and‐god.