Open Access
RAC-CNN: multimodal deep learning based automatic detection and classification of rod and cone photoreceptors in adaptive optics scanning light ophthalmoscope images
Author(s) -
David Cunefare,
Alison L Huckenpahler,
Eric Patterson,
Alfredo Dubra,
Joseph Carroll,
Sina Farsiu
Publication year - 2019
Publication title -
biomedical optics express
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.362
H-Index - 86
ISSN - 2156-7085
DOI - 10.1364/boe.10.003815
Subject(s) - achromatopsia , adaptive optics , artificial intelligence , scanning laser ophthalmoscopy , optics , computer science , computer vision , retina , optical coherence tomography , retinal , ophthalmology , physics , medicine
Quantification of the human rod and cone photoreceptor mosaic in adaptive optics scanning light ophthalmoscope (AOSLO) images is useful for the study of various retinal pathologies. Subjective and time-consuming manual grading has remained the gold standard for evaluating these images, with no well validated automatic methods for detecting individual rods having been developed. We present a novel deep learning based automatic method, called the rod and cone CNN (RAC-CNN), for detecting and classifying rods and cones in multimodal AOSLO images. We test our method on images from healthy subjects as well as subjects with achromatopsia over a range of retinal eccentricities. We show that our method is on par with human grading for detecting rods and cones.