Open AccessDeep Learning Based Super Resolution and Classification Applications for Neonatal Thermal Images
Author(s) -
Fatih Mehmet ŞENALP,
Murat Ceylan
Publication year - 2021
Publication title -
traitement du signal/ts. traitement du signal
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.279
H-Index - 11
eISSN - 1958-5608
pISSN - 0765-0019
DOI - 10.18280/ts.380511
Subject(s) - convolutional neural network , artificial intelligence , computer science , deep learning , generative adversarial network , ground truth , pattern recognition (psychology) , classifier (uml) , similarity (geometry) , image resolution , superresolution , peak signal to noise ratio , computer vision , image (mathematics)
The thermal camera systems can be used in all kinds of applications that require the detection of heat change, but thermal imaging systems are highly costly systems. In recent years, developments in the field of deep learning have increased the success by obtaining quality results compared to traditional methods. In this paper, thermal images of neonates (healthy - unhealthy) obtained from a high-resolution thermal camera were used and these images were evaluated as high resolution (ground truth) images. Later, these thermal images were downscaled at 1/2, 1/4, 1/8 ratios, and three different datasets consisting of low-resolution images in different sizes were obtained. In this way, super-resolution applications have been carried out on the deep network model developed based on generative adversarial networks (GAN) by using three different datasets. The successful performance of the results was evaluated with PSNR (peak signal to noise ratio) and SSIM (structural similarity index measure). In addition, healthy - unhealthy classification application was carried out by means of a classifier network developed based on convolutional neural networks (CNN) to evaluate the super-resolution images obtained using different datasets. The obtained results show the importance of combining medical thermal imaging with super-resolution methods.