arrow
Return

Prototype-Based Multiple Instance Learning for Gigapixel Whole Slide Image Classification

delete2026-01-01
delete0
PRE
AI
S
Susu Sun *
D
Dominique van Midden
G
Geert Litjens
C
Christian F. Baumgartner
DOI:10.1007/978-3-032-05185-1_49delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Multiple Instance Learning (MIL) methods have succeeded remarkably in histopathology whole slide image (WSI) analysis. However, most MIL models only offer attention-based explanations that do not faithfully capture the model's decision mechanism and do not allow human-model interaction. To address these limitations, we introduce ProtoMIL, an inherently interpretable MIL model for WSI analysis that offers user-friendly explanations and supports human intervention (Code can be found at https://github.com/ss-sun/ProtoMIL). Our approach employs a sparse autoencoder to discover human-interpretable concepts from the image feature space, which are then used to train ProtoMIL. The model represents predictions as linear combinations of concepts, making the decision process transparent. Furthermore, ProtoMIL allows users to perform model interventions by altering the input concepts. Experiments on two widely used pathology datasets demonstrate that ProtoMIL achieves a classification performance comparable to state-of-the-art MIL models while offering intuitively understandable explanations. Moreover, we demonstrate that our method can eliminate reliance on diagnostically irrelevant information via human intervention, guiding the model toward being right for the right reason.
Keywords:
XAI
Histopathology
Multiple Instance Learning

Journal

M
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2025, PT XIV
IF:
0
Papers:
59
Citations:
0

Organization

E
Eberhard Karls University of Tubingen
Scholars:
843
Papers: 341
Citations: 0
R
Radboud University Nijmegen
Scholars:
4.4W
Papers: 3.4W
Citations: 5.4W
Cited Papers

Cited Papers

Artificial intelligence for diagnosis and Gleason grading of prostate cancer: the PANDA challenge
err2022-01-13
err218
errOAAI
errBulten, Wouter; Kartasalo, Kimmo; Chen, Po-Hsuan Cameron; Strom, Peter; Pinckaers, Hans; Nagpal, Kunal; Cai, Yuannan; Steiner, David F.; van Boven, Hester; Vink, Robert; Hulsbergen-van de Kaa, Christina; van der Laak, Jeroen; Amin, Mahul B.; Evans, Andrew J.; van der Kwast, Theodorus; Allan, Robert; Humphrey, Peter A.; Gronberg, Henrik; Samaratunga, Hemamali; Delahunt, Brett; Tsuzuki, Toyonori; Hakkinen, Tomi; Egevad, Lars; Demkin, Maggie; Dane, Sohier; Tan, Fraser; Valkonen, Masi; Corrado, Greg S.; Peng, Lily; Mermel, Craig H.; Ruusuvuori, Pekka; Litjens, Geert; Eklund, Martin
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Shortcut learning in deep neural networks
err2020-11-10
err489
PREAI
errGeirhos, Robert; Jacobsen, Joern-Henrik; Michaelis, Claudio; Zemel, Richard; Brendel, Wieland; Bethge, Matthias; Wichmann, Felix A.
errShare
errSave
Data-efficient and weakly supervised computational pathology on whole-slide images
err2021-03-01
err733
errOAAI
errLu, Ming Y.; Williamson, Drew F. K.; Chen, Tiffany Y.; Chen, Richard J.; Barbieri, Matteo; Mahmood, Faisal
errShare
errSave
SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathology
err2024-06-16
err0
PREAI
errSaarthak Kapse; Pushpak Pati; Srijan Das; Jingwei Zhang; Chao Chen; Maria Vakalopoulou; Joel Saltz; Dimitris Samaras; Rajarsi R. Gupta; Prateek Prasanna
errShare
errSave
errShare
errSave
A visual-language foundation model for computational pathology
err2024-03-19
err31
errOAAI
errLu, Ming Y.; Chen, Bowen; Williamson, Drew F. K.; Chen, Richard J.; Liang, Ivy; Ding, Tong; Jaume, Guillaume; Odintsov, Igor; Le, Long Phi; Gerber, Georg; Parwani, Anil V.; Zhang, Andrew; Mahmood, Faisal
errShare
errSave
Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer
err2017-12-12
err2.0K
errOAAI
errBejnordi, Babak Ehteshami; Veta, Mitko; van Diest, Paul Johannes; van Ginneken, Bram; Karssemeijer, Nico; Litjens, Geert; van der Laak, Jeroen A. W. M.
errShare
errSave
no more