Premium
Real‐time video mosaicking to guide handheld in vivo microscopy
Author(s) -
Yin Chengbo,
Wei Linpeng,
Kose Kivanc,
Glaser Adam K.,
Peterson Gary,
Rajadhyaksha Milind,
Liu Jonathan T. C.
Publication year - 2020
Publication title -
journal of biophotonics
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.877
H-Index - 66
eISSN - 1864-0648
pISSN - 1864-063X
DOI - 10.1002/jbio.202000048
Subject(s) - microscope , computer vision , mobile device , computer science , artificial intelligence , pixel , confocal , confocal microscopy , microscopy , field of view , image processing , biomedical engineering , computer graphics (images) , optics , image (mathematics) , medicine , physics , operating system
Handheld and endoscopic optical‐sectioning microscopes are being developed for noninvasive screening and intraoperative consultation. Imaging a large extent of tissue is often desired, but miniature in vivo microscopes tend to suffer from limited fields of view. To extend the imaging field during clinical use, we have developed a real‐time video mosaicking method, which allows users to efficiently survey larger areas of tissue. Here, we modified a previous post‐processing mosaicking method so that real‐time mosaicking is possible at >30 frames/second when using a device that outputs images that are 400 × 400 pixels in size. Unlike other real‐time mosaicking methods, our strategy can accommodate image rotations and deformations that often occur during clinical use of a handheld microscope. We perform a feasibility study to demonstrate that the use of real‐time mosaicking is necessary to enable efficient sampling of a desired imaging field when using a handheld dual‐axis confocal microscope.