Premium
SU‐E‐J‐134: An Augmented‐Reality Optical Imaging System for Accurate Breast Positioning During Radiotherapy
Author(s) -
Nazareth D,
Malhotra H,
French S,
Hoffmann K,
Merrow C
Publication year - 2014
Publication title -
medical physics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.473
H-Index - 180
eISSN - 2473-4209
pISSN - 0094-2405
DOI - 10.1118/1.4888187
Subject(s) - computer vision , imaging phantom , artificial intelligence , computer science , augmented reality , translation (biology) , software , image registration , fiducial marker , calibration , computer graphics (images) , nuclear medicine , mathematics , medicine , image (mathematics) , biochemistry , chemistry , statistics , messenger rna , gene , programming language
Purpose: Breast radiotherapy, particularly electronic compensation, may involve large dose gradients and difficult patient positioning problems. We have developed a simple self‐calibrating augmented‐reality system, which assists in accurately and reproducibly positioning the patient, by displaying her live image from a single camera superimposed on the correct perspective projection of her 3D CT data. Our method requires only a standard digital camera capable of live‐view mode, installed in the treatment suite at an approximately‐known orientation and position (rotation R; translation T). Methods: A 10‐sphere calibration jig was constructed and CT imaged to provide a 3D model. The (R,T) relating the camera to the CT coordinate system were determined by acquiring a photograph of the jig and optimizing an objective function, which compares the true image points to points calculated with a given candidate R and T geometry. Using this geometric information, 3D CT patient data, viewed from the camera's perspective, is plotted using a Matlab routine. This image data is superimposed onto the real‐time patient image, acquired by the camera, and displayed using standard live‐view software. This enables the therapists to view both the patient's current and desired positions, and guide the patient into assuming the correct position. The method was evaluated using an in‐house developed bolus‐like breast phantom, mounted on a supporting platform, which could be tilted at various angles to simulate treatment‐like geometries. Results: Our system allowed breast phantom alignment, with an accuracy of about 0.5 cm and 1 ± 0.5 degree. Better resolution could be possible using a camera with higher‐zoom capabilities. Conclusion: We have developed an augmented‐reality system, which combines a perspective projection of a CT image with a patient's real‐time optical image. This system has the potential to improve patient setup accuracy during breast radiotherapy, and could possibly be used for other disease sites as well.