Premium
Video see‐through augmented reality for oral and maxillofacial surgery
Author(s) -
Wang Junchen,
Suenaga Hideyuki,
Yang Liangjing,
Kobayashi Etsuko,
Sakuma Ichiro
Publication year - 2017
Publication title -
the international journal of medical robotics and computer assisted surgery
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.556
H-Index - 53
eISSN - 1478-596X
pISSN - 1478-5951
DOI - 10.1002/rcs.1754
Subject(s) - overlay , computer science , computer vision , artificial intelligence , image registration , matching (statistics) , augmented reality , frame (networking) , tracking (education) , image (mathematics) , medicine , psychology , telecommunications , pedagogy , pathology , programming language
Background Oral and maxillofacial surgery has not been benefitting from image guidance techniques owing to the limitations in image registration. Methods A real‐time markerless image registration method is proposed by integrating a shape matching method into a 2D tracking framework. The image registration is performed by matching the patient's teeth model with intraoperative video to obtain its pose. The resulting pose is used to overlay relevant models from the same CT space on the camera video for augmented reality. Results The proposed system was evaluated on mandible/maxilla phantoms, a volunteer and clinical data. Experimental results show that the target overlay error is about 1 mm, and the frame rate of registration update yields 3–5 frames per second with a 4 K camera. Conclusions The significance of this work lies in its simplicity in clinical setting and the seamless integration into the current medical procedure with satisfactory response time and overlay accuracy. Copyright © 2016 John Wiley & Sons, Ltd.