Open AccessTransfer Learning in Polyp and Endoscopic Tool Segmentation from Colonoscopy Images
Author(s) -
Nefeli Panagiota Tzavara,
Bjørn-Jostein Singstad
Publication year - 2021
Publication title -
nordic machine intelligence
Language(s) - English
Resource type - Journals
ISSN - 2703-9196
DOI - 10.5617/nmi.9132
Subject(s) - colonoscopy , artificial intelligence , segmentation , dice , sørensen–dice coefficient , computer science , colorectal cancer , medicine , market segmentation , transfer of learning , image segmentation , radiology , cancer , mathematics , marketing , business , geometry
Colorectal cancer is one of the deadliest and most widespread types of cancer in the world. Colonoscopy is the procedure used to detect and diagnose polyps from the colon, but today's detection rate shows a significant error rate that affects diagnosis and treatment. An automatic image segmentation algorithm may help doctors to improve the detection rate of pathological polyps in the colon. Furthermore, segmenting endoscopic tools in images taken during colonoscopy may contribute towards robotic assisted surgery. In this study, we trained and validated both pre-trained and not pre-trained segmentation models on two different data sets, containing images of polyps and endoscopic tools. Finally, we applied the models on two separate test sets and the best polyp model got a dice score 0.857 and the test instrument model got a dice score 0.948. Moreover, we found that pre-training of the models increased the performance in segmenting polyps and endoscopic tools.