Premium
Single‐image Tomography: 3D Volumes from 2D Cranial X‐Rays
Author(s) -
Henzler Phlipp,
Rasche Volker,
Ropinski Timo,
Ritschel Tobias
Publication year - 2018
Publication title -
computer graphics forum
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.578
H-Index - 120
eISSN - 1467-8659
pISSN - 0167-7055
DOI - 10.1111/cgf.13369
Subject(s) - rendering (computer graphics) , volume rendering , computer science , artificial intelligence , convolutional neural network , stereoscopy , computer vision , deep learning , computer graphics (images) , tomography , volume (thermodynamics) , 3d rendering , data set , high resolution , optics , geology , physics , remote sensing , quantum mechanics
As many different 3D volumes could produce the same 2D x‐ray image, inverting this process is challenging. We show that recent deep learning‐based convolutional neural networks can solve this task. As the main challenge in learning is the sheer amount of data created when extending the 2D image into a 3D volume, we suggest firstly to learn a coarse, fixed‐resolution volume which is then fused in a second step with the input x‐ray into a high‐resolution volume. To train and validate our approach we introduce a new dataset that comprises of close to half a million computer‐simulated 2D x‐ray images of 3D volumes scanned from 175 mammalian species. Future applications of our approach include stereoscopic rendering of legacy x‐ray images, re‐rendering of x‐rays including changes of illumination, view pose or geometry. Our evaluation includes comparison to previous tomography work, previous learning methods using our data, a user study and application to a set of real x‐rays.