arrow
Return

A Methodology for Clinically Driven Interactive Segmentation Evaluation

delete2026-01-01
delete0
PRE
AI
E
Esmaeili, Parhom *
P
Pedro Borges
V
Virginia Fernandez
E
Eli Gibson
S
Sébastien Ourselin
M
M. Jorge Cardoso
DOI:10.1007/978-3-032-08970-0_2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Interactive segmentation is a promising strategy for building robust, generalisable algorithms for volumetric medical image segmentation. However, inconsistent and clinically unrealistic evaluation hinders fair comparison and misrepresents real-world performance. We propose a clinically grounded methodology for defining evaluation tasks and metrics, and built a software framework for constructing standardised evaluation pipelines. We evaluate state-of-the-art algorithms across heterogeneous and complex tasks and observe that (i) minimising information loss when processing user interactions is critical for model robustness, (ii) adaptive-zooming mechanisms boost robustness and speed convergence, (iii) performance drops if validation prompting behaviour/budgets differ from training, (iv) 2D methods perform well with slab-like images and coarse targets, but 3D context helps with large or irregularly shaped targets, (v) performance of non-medical-domain models (e.g. SAM2) degrades with poor contrast and complex shapes.
Keywords:
Validation
Interactive Segmentation
Data Annotation

Journal

H
HUMAN-AI COLLABORATION, HAIC 2025
IF:
0
Papers:
7
Citations:
0

Organization

K
king's college london
Scholars:
5.7K
Papers: 2.8K
Citations: 0
U
university of london
Scholars:
21.5W
Papers: 19.7W
Citations: 305
Cited Papers

Cited Papers

Metrics reloaded: recommendations for image analysis validation
err2024-02-12
err59
errOAAI
errMaier-Hein, Lena; Reinke, Annika; Godau, Patrick; Tizabi, Minu D.; Buettner, Florian; Christodoulou, Evangelia; Glocker, Ben; Isensee, Fabian; Kleesiek, Jens; Kozubek, Michal; Reyes, Mauricio; Riegler, Michael A.; Wiesenfarth, Manuel; Kavur, A. Emre; Sudre, Carole H.; Baumgartner, Michael; Eisenmann, Matthias; Heckmann-Noetzel, Doreen; Raedsch, Tim; Acion, Laura; Antonelli, Michela; Arbel, Tal; Bakas, Spyridon; Benis, Arriel; Blaschko, Matthew B.; Cardoso, M. Jorge; Cheplygina, Veronika; Cimini, Beth A.; Collins, Gary S.; Farahani, Keyvan; Ferrer, Luciana; Galdran, Adrian; van Ginneken, Bram; Haase, Robert; Hashimoto, Daniel A.; Hoffman, Michael M.; Huisman, Merel; Jannin, Pierre; Kahn, Charles E.; Kainmueller, Dagmar; Kainz, Bernhard; Karargyris, Alexandros; Karthikesalingam, Alan; Kofler, Florian; Kopp-Schneider, Annette; Kreshuk, Anna; Kurc, Tahsin; Landman, Bennett A.; Litjens, Geert; Madani, Amin; Maier-Hein, Klaus; Martel, Anne L.; Mattson, Peter; Meijering, Erik; Menze, Bjoern; Moons, Karel G. M.; Mueller, Henning; Nichyporuk, Brennan; Nickel, Felix; Petersen, Jens; Rajpoot, Nasir; Rieke, Nicola; Saez-Rodriguez, Julio; Sanchez, Clara I.; Shetty, Shravya; van Smeden, Maarten; Summers, Ronald M.; Taha, Abdel A.; Tiulpin, Aleksei; Tsaftaris, Sotirios A.; Van Calster, Ben; Varoquaux, Gael; Jaeger, Paul F.
errShare
errSave
Automated Segmentation of Tissues Using CT and MRI: A Systematic Review
err2019-12-01
err93
errOAAI
errLenchik, Leon; Heacock, Laura; Weaver, Ashley A.; Boutin, Robert D.; Cook, Tessa S.; Itri, Jason; Filippi, Christopher G.; Gullapalli, Rao P.; Lee, James; Zagurovskaya, Marianna; Retson, Tara; Godwin, Kendra; Nicholson, Joey; Narayana, Ponnada A.
errShare
errSave
errShare
errSave
The Medical Segmentation Decathlon
err2022-07-15
err371
errOAAI
errAntonelli, Michela; Reinke, Annika; Bakas, Spyridon; Farahani, Keyvan; Kopp-Schneider, Annette; Landman, Bennett A.; Litjens, Geert; Menze, Bjoern; Ronneberger, Olaf; Summers, Ronald M.; van Ginneken, Bram; Bilello, Michel; Bilic, Patrick; Christ, Patrick F.; Do, Richard K. G.; Gollub, Marc J.; Heckers, Stephan H.; Huisman, Henkjan; Jarnagin, William R.; McHugo, Maureen K.; Napel, Sandy; Pernicka, Jennifer S. Golia; Rhode, Kawal; Tobon-Gomez, Catalina; Vorontsov, Eugene; Meakin, James A.; Ourselin, Sebastien; Wiesenfarth, Manuel; Arbelaez, Pablo; Bae, Byeonguk; Chen, Sihong; Daza, Laura; Feng, Jianjiang; He, Baochun; Isensee, Fabian; Ji, Yuanfeng; Jia, Fucang; Kim, Ildoo; Maier-Hein, Klaus; Merhof, Dorit; Pai, Akshay; Park, Beomhee; Perslev, Mathias; Rezaiifar, Ramin; Rippel, Oliver; Sarasua, Ignacio; Shen, Wei; Son, Jaemin; Wachinger, Christian; Wang, Liansheng; Wang, Yan; Xia, Yingda; Xu, Daguang; Xu, Zhanwei; Zheng, Yefeng; Simpson, Amber L.; Maier-Hein, Lena; Cardoso, M. Jorge
errShare
errSave
SNAKES - ACTIVE CONTOUR MODELS
err1988-01-01
err1.0W
PREAI
errKASS, M; WITKIN, A; TERZOPOULOS, D
errShare
errSave
A whole-body FDG-PET/CT Dataset with manually annotated Tumor Lesions
err2022-10-04
err0
errOAAI
errSergios Gatidis; Tobias Hepp; Marcel Früh; Christian La Fougère; Konstantin Nikolaou; Christina Pfannenberg; Bernhard Schölkopf; Thomas Küstner; Clemens Cyran; Daniel Rubin
errShare
errSave
User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability
err2006-07-01
err0
errOAAI
errPaul A. Yushkevich; Joseph Piven; Heather Cody Hazlett; Rachel Gimpel Smith; Sean Ho; James C. Gee; Guido Gerig
errShare
errSave
nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation
err2020-12-07
err3.5K
PREAI
errIsensee, Fabian; Jaeger, Paul F.; Kohl, Simon A. A.; Petersen, Jens; Maier-Hein, Klaus H.
errShare
errSave
Segment Anything
err2023-10-01
err0
PREAI
errAlexander Kirillov; Eric Mintun; Nikhila Ravi; Hanzi Mao; Chloe Rolland; Laura Gustafson; Tete Xiao; Spencer Whitehead; Alexander C. Berg; Wan-Yen Lo; Piotr Dollár; Ross Girshick
errShare
errSave
A guide to sharing open healthcare data under the General Data Protection Regulation
err2023-06-24
err0
errOAAI
errJip W. T. M. de Kok; Miguel Á. Armengol de la Hoz; Ymke de Jong; Véronique Brokke; Paul W. G. Elbers; Patrick Thoral; Alejandro Castillejo; Tomás Trenor; Jose M. Castellano; Alberto E. Bronchalo; Tobias M. Merz; Martin Faltys; Cristina Casares; Araceli Jiménez; Jaime Requejo; Sonia Gutiérrez; David Curto; Gunnar Rätsch; Jan M. Peppink; Ronald H. Driessen; Eric J. G. Sijbrands; Erwin J. O. Kompanje; Armand R. J. Girbes; Jose Barberan; Jose Felipe Varona; Paula Villares; Iwan C. C. van der Horst; Minnan Xu; Leo Anthony Celi; Bas C. T. van Bussel; Xavier Borrat
errShare
errSave
researcher View more