返回
Cross-scale multi-instance learning for pathological image diagnosis
DOI:10.1016/j.media.2024.103124.png)
摘要
En 中文
Analyzing high resolution whole slide images (WSIs) with regard to information across multiple scales poses a significant challenge in digital pathology. Multi-instance learning (MIL) is a common solution for working with high resolution images by classifying bags of objects ( i.e. sets of smaller image patches). However, such processing is typically performed at a single scale ( e.g. , 20 x magnification) of WSIs, disregarding the vital inter-scale information that is key to diagnoses by human pathologists. In this study, we propose a novel crossscale MIL algorithm to explicitly aggregate inter-scale relationships into a single MIL network for pathological image diagnosis. The contribution of this paper is three-fold: (1) A novel cross-scale MIL (CS-MIL) algorithm that integrates the multi-scale information and the inter-scale relationships is proposed; (2) A toy dataset with scale-specific morphological features is created and released to examine and visualize differential crossscale attention; (3) Superior performance on both in-house and public datasets is demonstrated by our simple cross-scale MIL strategy. The official implementation is publicly available at https://github.com/hrlblab/CSMIL.
Keyword:
Multi-instance learning
Multi-scale
Attention mechanism
Pathology
期刊
IF:
11.8
论文数:
3.9K
被引数:
2.4W
机构
引用论文
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images在整个幻灯片图像上使用弱监督深度学习的临床级计算病理学
NATURE MEDICINE
IF50
Data-efficient and weakly supervised computational pathology on whole-slide images全载玻片图像上的数据高效和弱监督计算病理学
Artificial intelligence applications in inflammatory bowel disease: Emerging technologies and future directions人工智能在炎症性肠病中的应用: 新兴技术与未来方向
Whole slide images based cancer survival prediction using attention guided deep multiple instance learning networks使用注意力引导的深度多示例学习网络基于全幻灯片图像的癌症生存预测
MEDICAL IMAGE ANALYSIS
IF11.8

