Premium
Deep Transfer Learning for Image‐Based Structural Damage Recognition
Author(s) -
Gao Yuqing,
Mosalam Khalid M.
Publication year - 2018
Publication title -
computer‐aided civil and infrastructure engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.773
H-Index - 82
eISSN - 1467-8667
pISSN - 1093-9687
DOI - 10.1111/mice.12363
Subject(s) - overfitting , computer science , artificial intelligence , extractor , transfer of learning , feature (linguistics) , pattern recognition (psychology) , deep learning , image (mathematics) , scope (computer science) , machine learning , artificial neural network , engineering , linguistics , philosophy , process engineering , programming language
This article implements the state‐of‐the‐art deep learning technologies for a civil engineering application, namely recognition of structural damage from images. Inspired by ImageNet Challenge and the development of computer hardware, the concept of Structural ImageNet is proposed herein with four naïve baseline recognition tasks: component type identification, spalling condition check, damage level evaluation, and damage type determination. A relatively small number of images (2,000) are selected from the Structural ImageNet and manually labeled according to the four recognition tasks. In order to avoid overfitting, Transfer Learning (TL) based on VGGNet (Visual Geometry Group) is introduced and applied using two different strategies, namely feature extractor and fine‐tuning. Two experiments are designed based on properties of these two strategies to find the relative optimal model parameters and scope of application. Models obtained by both strategies indicate the promising recognition results and different application potentials where feature extractor and fine‐tuning can be respectively used for preliminary analysis and for further improvement. These results also reveal the potential uses of deep TL in image‐based structural damage recognition.