Ranking-Aware Multiple Instance Learning for Histopathology Slide Classification: Development and Validation Study

doi:10.2196/84417

Ranking-Aware Multiple Instance Learning for Histopathology Slide Classification: Development and Validation Study

2026-01-01

0

PRE

AI

DOI：10.2196/84417

Original request for help

Save

Abstract

En 中文

Background: Multipleinstancelearning (MIL) iswidelyusedforslide-levelclassification indigital pathologywithoutrequiring expert annotations. However, even partial expert annotations offer valuable supervision; fewstudies have effectively leveraged this information within MIL frameworks. Objective: This study aims to develop and evaluate a ranking-aware MIL framework, called rank induction, that effectively incorporates partial expert annotations to improve slide-level classification performance under realistic annotation constraints. Methods: We developed rank induction, a MIL approach that incorporates expert annotations using a pairwise rank loss inspired by RankNet. The method encourages the model to assign higher attention scores to annotated regions than to unannotated ones, guiding it to focus on diagnostically relevant patches. We evaluated rank induction on 2 public datasets (Camelyon16 and DigestPath2019) and an in-house dataset (Seegene Medical Foundation-stomach; SMF-stomach) and tested its robustness under 3 real-world conditions: low-data regimes, coarse within-slide annotations, and sparse slide-level annotations. Results: Rank induction outperformed existing methodologies, achieving an area under the receiver operating characteristic curve (AUROC) of 0.839 on Camelyon16, 0.995 on DigestPath2019, and 0.875 on SMF-stomach. It remained robust under low-data conditions, maintaining an AUROC of 0.761 with only 60.2% (130/216) of the training data. When using coarse annotations (with 2240-pixel padding), performance slightly declined to 0.823. Remarkably, annotating just 20% (18/89) of the slides was enough to reach near-saturated performance (AUROC of 0.806, vs 0.839 with full annotations). Conclusions:Incorporating expert annotations through ranking-based supervision improves MIL-based classification. Rank induction remains robust even with limited, coarse, or sparsely available annotations, demonstrating its practicality in real-world scenarios.

Keywords:

multiple instance learning

learning to rank

digital pathology

whole slide image

weakly supervised learning

mixed supervision

data-efficient training

Ranking-Aware Multiple Instance Learning for Histopathology Slide Classification: Development and Validation Study

Abstract

Journal

Organization

Cited Papers