Open AccessA Survey of Crowdsourcing in Medical Image Analysis
Author(s) -
Silas Nyboe Ørting,
Andrew Doyle,
Arno van Hilten,
Matthias Hirth,
Oana Inel,
Christopher R. Madan,
Panagiotis Mavridis,
Helen Spiers,
Veronika Cheplygina
Publication year - 2020
Publication title -
human computation
Language(s) - English
Resource type - Journals
ISSN - 2330-8001
DOI - 10.15346/hc.v7i1.111
Subject(s) - crowdsourcing , popularity , data science , computer science , realm , big data , scale (ratio) , domain (mathematical analysis) , quality (philosophy) , data mining , world wide web , psychology , social psychology , mathematical analysis , philosophy , physics , mathematics , epistemology , quantum mechanics , political science , law
Rapid advances in image processing capabilities have been seen across many domains, fostered by the application of machine learning algorithms to "big-data". However, within the realm of medical image analysis, advances have been curtailed, in part, due to the limited availability of large-scale, well-annotated datasets. One of the main reasons for this is the high cost often associated with producing large amounts of high-quality meta-data. Recently, there has been growing interest in the application of crowdsourcing for this purpose; a technique that has proven effective for creating large-scale datasets across a range of disciplines, from computer vision to astrophysics. Despite the growing popularity of this approach, there has not yet been a comprehensive literature review to provide guidance to researchers considering using crowdsourcing methodologies in their own medical imaging analysis. In this survey, we review studies applying crowdsourcing to the analysis of medical images, published prior to July 2018. We identify common approaches, challenges and considerations, providing guidance of utility to researchers adopting this approach. Finally, we discuss future opportunities for development within this emerging domain.