1
Return

PathRWKV: Enhancing Whole Slide Image Inference With Asymmetric Recurrent Modeling

delete2026-06-08
delete0
PRE
AI
T
Tianyi Zhang
陈思成 cover
陈思成 (Sicheng Chen)
B
Borui Kang
D
Dankai Liao
Q
Qiaochu Xue
B
Bochong Zhang
F
Fei Xia
E
Enhui Chai
Y
Yueming Jin
DOI:10.1109/tmi.2026.3700967delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Whole Slide Imaging (WSI) has become a gold standard in cancer diagnosis, inspecting multi-scale information from cellular to tissue levels. Processing an entire WSI directly is infeasible due to GPU memory constraints; thus, Multiple Instance Learning (MIL) has emerged as the standard solution by partitioning WSIs into tiles. While recent two-stage MIL frameworks partially achieve memory efficiency by decoupling tile-level extraction from slide-level modeling, they still face four limitations: 1) the conflict between training throughput and inference memory efficiency, 2) the high susceptibility to overfitting on small-scale WSI datasets with sparse supervision, 3) the disruption of spatial structural integrity during sampling-based training, and 4) the inadequate modeling of multi-scale feature interactions within long sequences. We therefore introduce PathRWKV, a novel State Space Model designed for efficient and robust WSI analysis. To resolve the computational trade-off, we propose an asymmetric structure utilizing max pooling aggregation, enabling parallelized training for high throughput and recurrent inference with constant (<inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">$\mathcal {O}\text {(}{1}\text {)}$ </tex-math></inline-formula>) memory complexity. To mitigate overfitting, we employ random sampling to enhance data diversity, with a multi-task learning module to regularize feature learning on limited data. To restore spatial context, we introduce 2D sinusoidal position encoding to perceive the relative locations of tissue tiles. To capture comprehensive representations, we integrate TimeMix and ChannelMix modules, enabling dynamic multi-scale feature modeling across temporal and spatial dimensions. Experiments on 29,073 WSIs across 11 datasets demonstrate that PathRWKV outperforms 11 state-of-the-art methods on 10 datasets, establishing it as a scalable and solution with application potential.
Keywords:
Whole slide image analysis
multiple instance learning
multi-task learning
state space model

Journal

IEEE Transactions on Medical Imaging cover
IEEE Transactions on Medical Imaging
IF:
9.8
Papers:
6.2K
Citations:
3.7W

Organization

P
puzzlelogic pte ltd
Scholars:
5
Papers: 3
Citations: 0
N
National University of Singapore
Scholars:
7.4W
Papers: 6.4W
Citations: 11.4W
U
university of california irvine
Scholars:
2.2W
Papers: 1.7W
Citations: 55
Cited Papers

Cited Papers

Citing Papers

Citing Papers