arrow
返回

Probabilistic Attention Based on Gaussian Processes for Deep Multiple Instance Learning

delete2024-08-01
delete8
delete
OA
AI
A
Arne Schmidt *
P
Pablo Morales-Álvarez
R
Rafael Molina
DOI:10.1109/TNNLS.2023.3245329delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multiple instance learning (MIL) is a weakly supervised learning paradigm that is becoming increasingly popular because it requires less labeling effort than fully supervised methods. This is especially interesting for areas where the creation of large annotated datasets remains challenging, as in medicine. Although recent deep learning MIL approaches have obtained state-of-the-art results, they are fully deterministic and do not provide uncertainty estimations for the predictions. In this work, we introduce the attention Gaussian process (AGP) model, a novel probabilistic attention mechanism based on Gaussian processes (GPs) for deep MIL. AGP provides accurate bag-level predictions as well as instance-level explainability and can be trained end-to-end. Moreover, its probabilistic nature guarantees robustness to overfit on small datasets and uncertainty estimations for the predictions. The latter is especially important in medical applications, where decisions have a direct impact on the patient's health. The proposed model is validated experimentally as follows. First, its behavior is illustrated in two synthetic MIL experiments based on the well-known MNIST and CIFAR-10 datasets, respectively. Then, it is evaluated in three different real-world cancer detection experiments. AGP outperforms state-of-the-art MIL approaches, including deterministic deep learning ones. It shows a strong performance even on a small dataset with less than 100 labels and generalizes better than competing methods on an external test set. Moreover, we experimentally show that predictive uncertainty correlates with the risk of wrong predictions, and therefore it is a good indicator of reliability in practice. Our code is publicly available.
Keyword:
Attention mechanism
digital pathology
Gaus-sian processes (GPs)
multiple instance learning (MIL)
whole slide images (WSIs)

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.6K
被引数:
7.2W

机构

U
University of Granada
学者数:
2.3W
论文数: 1.9W
被引数: 24
引用论文

引用论文

Charting trends in the evolution of the La Alhambra forest (Granada, Spain) through analysis of pollen-emission dynamics over time
err2016-01-12
err0
PREAI
errPaloma Cariñanos; Manuel Casares-Porcel; Ana Valle Díaz de la Guardia; Rafael De la Cruz-Márquez; Consuelo Díaz de la Guardia
err分享
err收藏
Clinical-grade computational pathology using weakly supervised deep learning on whole slide images在整个幻灯片图像上使用弱监督深度学习的临床级计算病理学
err2019-07-15
err1.4K
errOAAI
errCampanella, Gabriele; Hanna, Matthew G.; Geneslaw, Luke; Miraflor, Allen; Silva, Vitor Werneck Krauss; Busam, Klaus J.; Brogi, Edi; Reuter, Victor E.; Klimstra, David S.; Fuchs, Thomas J.
err分享
err收藏
Data-efficient and weakly supervised computational pathology on whole-slide images全载玻片图像上的数据高效和弱监督计算病理学
err2021-03-01
err733
errOAAI
errLu, Ming Y.; Williamson, Drew F. K.; Chen, Tiffany Y.; Chen, Richard J.; Barbieri, Matteo; Mahmood, Faisal
err分享
err收藏
Learning from crowds in digital pathology using scalable variational Gaussian processes
err2021-06-02
err12
errOAAI
errLopez-Perez, Miguel; Amgad, Mohamed; Morales-Alvarez, Pablo; Ruiz, Pablo; Cooper, Lee A. D.; Molina, Rafael; Katsaggelos, Aggelos K.
err分享
err收藏
Scalable and efficient learning from crowds with Gaussian processes
err2019-12-01
err17
errOAAI
errMorales-Alvarez, Pablo; Ruiz, Pablo; Santos-Rodriguez, Raul; Molina, Rafael; Katsaggelos, Aggelos K.
err分享
err收藏
Learning from crowds with variational Gaussian processes
err2019-04-01
err33
errOAAI
errRuiz, Pablo; Morales-Alvarez, Pablo; Molina, Rafael; Katsaggelos, Aggelos K.
err分享
err收藏
学者 查看更多内容