arrow
Return

Cross-scale multi-instance learning for pathological image diagnosis

delete2024-05-01
delete5
delete
OA
AI
R
Ruining Deng
C
Can Cui
L
Lucas W. Remedios
S
Shunxing Bao
R
R. Michael Womick
S
Sophie Chiron
J
Jia Li
J
Joseph T. Roland
K
Ken S. Lau
刘祺 cover
刘祺 (Qi Liu)
K
Keith T. Wilson
Y
Yaohong Wang
L
Lori A. Coburn
B
Bennett A. Landman
Y
Yuankai Huo *
DOI:10.1016/j.media.2024.103124delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Analyzing high resolution whole slide images (WSIs) with regard to information across multiple scales poses a significant challenge in digital pathology. Multi-instance learning (MIL) is a common solution for working with high resolution images by classifying bags of objects ( i.e. sets of smaller image patches). However, such processing is typically performed at a single scale ( e.g. , 20 x magnification) of WSIs, disregarding the vital inter-scale information that is key to diagnoses by human pathologists. In this study, we propose a novel crossscale MIL algorithm to explicitly aggregate inter-scale relationships into a single MIL network for pathological image diagnosis. The contribution of this paper is three-fold: (1) A novel cross-scale MIL (CS-MIL) algorithm that integrates the multi-scale information and the inter-scale relationships is proposed; (2) A toy dataset with scale-specific morphological features is created and released to examine and visualize differential crossscale attention; (3) Superior performance on both in-house and public datasets is demonstrated by our simple cross-scale MIL strategy. The official implementation is publicly available at https://github.com/hrlblab/CSMIL.
Keywords:
Multi-instance learning
Multi-scale
Attention mechanism
Pathology

Journal

Medical Image Analysis cover
Medical Image Analysis
IF:
11.8
Papers:
3.9K
Citations:
2.4W

Organization

U
university of north carolina
Scholars:
7.4W
Papers: 6.5W
Citations: 93
V
vanderbilt university
Scholars:
5.1W
Papers: 4.1W
Citations: 59
U
University of North Carolina Chapel Hill
Scholars:
3.9W
Papers: 3.1W
Citations: 46
researcher View more organizations
Cited Papers

Cited Papers

Succession of Cainozoic Vertebrate Assemblages from the Northern Kenya Rift Valley
err1971-10-01
err0
PREAI
errW. W. BISHOP; G. R. CHAPMAN; A. HILL; J. A. MILLER
errShare
errSave
Synthesis and Q,e Values of New Fluorine-Containing Monomer: Pentafluorophenylmethyl Methacrylate
err1989-11-01
err0
errOAAI
errTadashi Narita; Tokio Hagiwara; Hiroshi Hamana; Keitaro Dei; Yukinori Shoji
errShare
errSave
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images
err2019-07-15
err1.4K
errOAAI
errCampanella, Gabriele; Hanna, Matthew G.; Geneslaw, Luke; Miraflor, Allen; Silva, Vitor Werneck Krauss; Busam, Klaus J.; Brogi, Edi; Reuter, Victor E.; Klimstra, David S.; Fuchs, Thomas J.
errShare
errSave
Data-efficient and weakly supervised computational pathology on whole-slide images
err2021-03-01
err733
errOAAI
errLu, Ming Y.; Williamson, Drew F. K.; Chen, Tiffany Y.; Chen, Richard J.; Barbieri, Matteo; Mahmood, Faisal
errShare
errSave
err2003-01-01
err0
PREAI
errXavier Descombes; Eugène Pechersky
errShare
errSave
Artificial intelligence applications in inflammatory bowel disease: Emerging technologies and future directions
err2021-05-07
err67
errOAAI
errGubatan, John; Levitte, Steven; Patel, Akshar; Balabanis, Tatiana; Wei, Mike T.; Sinha, Sidhartha R.
errShare
errSave
Deep Learning for Whole Slide Image Analysis: An Overview
err2019-11-22
err196
errOAAI
errDimitriou, Neofytos; Arandjelovic, Ognjen; Caie, Peter D.
errShare
errSave
Whole slide images based cancer survival prediction using attention guided deep multiple instance learning networks
err2020-10-01
err249
errOAAI
errYao, Jiawen; Zhu, Xinliang; Jonnagaddala, Jitendra; Hawkins, Nicholas; Huang, Junzhou
errShare
errSave
A monoclonal antibody to murine CD45R distinguishes CD4 T cell populations that produce different cytokines
err2005-11-22
err0
PREAI
errKim Bottomly; Mohammad Luqman; Laurence Greenbaum; Simon Carding; Jeff West; Theresa Pasqualini; Donal B. Murphy
errShare
errSave
researcher View more