Premium
Three‐dimensional image volumes from two‐dimensional digitally reconstructed radiographs: A deep learning approach in lower limb CT scans
Author(s) -
Almeida Diogo F.,
Astudillo Patricio,
Vandermeulen Dirk
Publication year - 2021
Publication title -
medical physics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.473
H-Index - 180
eISSN - 2473-4209
pISSN - 0094-2405
DOI - 10.1002/mp.14835
Subject(s) - deep learning , artificial intelligence , convolutional neural network , computer science , radiography , computer vision , 3d reconstruction , medical imaging , ground truth , modality (human–computer interaction) , iterative reconstruction , similarity (geometry) , radiology , image (mathematics) , medicine
Purpose Three‐dimensional (3D) reconstructions of the human anatomy have been available for surgery planning or diagnostic purposes for a few years now. The different image modalities usually rely on several consecutive two‐dimensional (2D) acquisitions in order to reconstruct the 3D volume. Hence, such acquisitions are expensive, time‐demanding and often expose the patient to an undesirable amount of radiation. For such reasons, along the most recent years, several studies have been proposed that extrapolate 3D anatomical features from merely 2D exams such as x rays for implant templating in total knee or hip arthroplasties. Method The presented study shows an adaptation of a deep learning‐based convolutional neural network to reconstruct 3D volumes from a mere 2D digitally reconstructed radiograph from one of the most extensive lower limb computed tomography datasets available. This novel approach is based on an encoder‐decoder architecture with skip connections and a multidimensional Gaussian filter as data augmentation technique. Results The results achieved promising values when compared against the ground truth volumes, quantitatively yielding an average of 0.77 ± 0.05 structured similarity index. Conclusions A novel deep learning‐based approach to reconstruct 3D medical image volumes from a single x‐ray image was shown in the present study. The network architecture was validated against the original scans presenting SSIM values of 0.77 ± 0.05 and 0.78 ± 0.06, respectively for the knee and the hip crop.