Open AccessQuick Annotator: an open‐source digital pathology based rapid image annotation tool
Author(s) -
Miao Runtian,
Toth Robert,
Zhou Yu,
Madabhushi Anant,
Janowczyk Andrew
Publication year - 2021
Publication title -
the journal of pathology: clinical research
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 1.849
H-Index - 21
ISSN - 2056-4538
DOI - 10.1002/cjp2.229
Subject(s) - computer science , annotation , digital pathology , segmentation , information retrieval , biomarker , digital image analysis , artificial intelligence , open source , computer vision , biology , software , biochemistry , programming language
Abstract Image‐based biomarker discovery typically requires accurate segmentation of histologic structures (e.g. cell nuclei, tubules, and epithelial regions) in digital pathology whole slide images (WSIs). Unfortunately, annotating each structure of interest is laborious and often intractable even in moderately sized cohorts. Here, we present an open‐source tool, Quick Annotator (QA), designed to improve annotation efficiency of histologic structures by orders of magnitude. While the user annotates regions of interest (ROIs) via an intuitive web interface, a deep learning (DL) model is concurrently optimized using these annotations and applied to the ROI. The user iteratively reviews DL results to either (1) accept accurately annotated regions or (2) correct erroneously segmented structures to improve subsequent model suggestions, before transitioning to other ROIs. We demonstrate the effectiveness of QA over comparable manual efforts via three use cases. These include annotating (1) 337,386 nuclei in 5 pancreatic WSIs, (2) 5,692 tubules in 10 colorectal WSIs, and (3) 14,187 regions of epithelium in 10 breast WSIs. Efficiency gains in terms of annotations per second of 102×, 9×, and 39× were, respectively, witnessed while retaining f ‐scores >0.95, suggesting that QA may be a valuable tool for efficiently fully annotating WSIs employed in downstream biomarker studies.