.png){kind=icon}
返回
Abnormality-aware multimodal learning for WSI classification
.png){kind=icon}
OA
AI
DOI：10.3389/fmed.2025.1546452.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Whole slide images (WSIs) play a vital role in cancer diagnosis and prognosis. However, their gigapixel resolution, lack of pixel-level annotations, and reliance on unimodal visual data present challenges for accurate and efficient computational analysis. Existing methods typically divide WSIs into thousands of patches, which increases computational demands and makes it challenging to effectively focus on diagnostically relevant regions. Furthermore, these methods frequently rely on feature extractors pretrained on natural images, which are not optimized for pathology tasks, and overlook multimodal data sources such as cellular and textual information that can provide critical insights. To address these limitations, we propose the Abnormality-Aware MultiModal (AAMM) learning framework, which integrates abnormality detection and multimodal feature learning for WSI classification. AAMM incorporates a Gaussian Mixture Variational Autoencoder (GMVAE) to identify and select the most informative patches, reducing computational complexity while retaining critical diagnostic information. It further integrates multimodal features from pathology-specific foundation models, combining patch-level, cell-level, and text-level representations through cross-attention mechanisms. This approach enhances the ability to comprehensively analyze WSIs for cancer diagnosis and subtyping. Extensive experiments on normal-tumor classification and cancer subtyping demonstrate that AAMM achieves superior performance compared to state-of-the-art methods. By combining abnormal detection with multimodal feature integration, our framework offers an efficient and scalable solution for advancing computational pathology.
Keyword:
WSI analysis
multimodal fusion
abnormal detection
foundation model
Gaussian Mixture Variational Autoencoder
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
F
IF:
3
论文数:
2.2W
被引数:
4.0W
机构
引用论文
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images在整个幻灯片图像上使用弱监督深度学习的临床级计算病理学.png)
NATURE MEDICINEOAAI
NATURE MEDICINEIF50
OAAI分享收藏A large French multicenter retrospective series of T1-T2N0 vocal cords carcinomas treated with exclusive irradiation一项针对接受单纯放射治疗的T1-T2N0声带癌的大规模法国多中心回顾性研究系列。
PREAI
分享收藏Effect of Oscillatory Water Flow on Burrowing Behaviors of the Japanese Surf Clam Pseudocardium sachalinensis.振荡水流对日本沙海螂 Pseudocardium sachalinensis 挖穴行为的影响。OAAI
OAAI分享收藏Data-efficient and weakly supervised computational pathology on whole-slide images全载玻片图像上的数据高效和弱监督计算病理学OAAI
OAAI分享收藏分享收藏
查看更多内容