Open AccessA Holographic Augmented Reality Interface for Visualizing of MRI Data and Planning of Neurosurgical Procedures
Author(s) -
Cristina Marie Morales Mojica,
Jose D. Velazco-Garcia,
E. Pappas,
Theodosios Birbilis,
Aaron T. Becker,
Ernst L. Leiss,
Andrew Webb,
Ioannis Seimenis,
Nikolaos V. Tsekos
Publication year - 2021
Publication title -
journal of digital imaging
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.055
H-Index - 58
eISSN - 1618-727X
pISSN - 0897-1889
DOI - 10.1007/s10278-020-00412-3
Subject(s) - visualization , computer science , augmented reality , interface (matter) , surgical planning , holography , human–computer interaction , computer vision , data visualization , computer graphics (images) , magnetic resonance imaging , artificial intelligence , radiology , medicine , physics , bubble , maximum bubble pressure method , parallel computing , optics
The recent introduction of wireless head-mounted displays (HMD) promises to enhance 3D image visualization by immersing the user into 3D morphology. This work introduces a prototype holographic augmented reality (HAR) interface for the 3D visualization of magnetic resonance imaging (MRI) data for the purpose of planning neurosurgical procedures. The computational platform generates a HAR scene that fuses pre-operative MRI sets, segmented anatomical structures, and a tubular tool for planning an access path to the targeted pathology. The operator can manipulate the presented images and segmented structures and perform path-planning using voice and gestures. On-the-fly, the software uses defined forbidden-regions to prevent the operator from harming vital structures. In silico studies using the platform with a HoloLens HMD assessed its functionality and the computational load and memory for different tasks. A preliminary qualitative evaluation revealed that holographic visualization of high-resolution 3D MRI data offers an intuitive and interactive perspective of the complex brain vasculature and anatomical structures. This initial work suggests that immersive experiences may be an unparalleled tool for planning neurosurgical procedures.