arrow
Return

Weakly Supervised Pixel-Level Annotation with Visual Interpretability

delete2026-01-01
delete0
delete
OA
AI
B
Basma Nasir *
T
Tehseen Zia
M
Muhammad Nawaz
C
Catarina Moreira
DOI:10.1007/978-3-032-08317-3_19delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Medical image annotation is essential for diagnosing diseases, yet manual annotation is time-consuming, costly, and prone to variability among experts. To address these challenges, we propose an automated explainable annotation system that integrates ensemble learning, visual explainability, and uncertainty quantification. Our approach combines three pre-trained deep learning models-ResNet50, EfficientNet, and DenseNet-enhanced with XGrad-CAM for visual explanations and Monte Carlo Dropout for uncertainty quantification. This ensemble mimics the consensus of multiple radiologists by intersecting saliency maps from models that agree on the diagnosis while uncertain predictions are flagged for human review. We evaluated our system using the TBX11K medical imaging dataset and a Fire segmentation dataset, demonstrating its robustness across different domains. Experimental results show that our method outperforms baseline models, achieving 93.04% accuracy on TBX11K and 96.4% accuracy on the Fire dataset. Moreover, our model produces precise pixel-level annotations despite being trained with only image-level labels, achieving Intersection over Union IoU scores of 36.07% and 64.7%, respectively. By enhancing the accuracy and interpretability of image annotations, our approach offers a reliable and transparent solution for medical diagnostics and other image analysis tasks.
Keywords:
Medical Image Annotation
Image Segmentation
Uncertainty Quantification
Ensemble Learning
Explainable Artificial Intelligence

Journal

E
EXPLAINABLE ARTIFICIAL INTELLIGENCE, XAI 2025, PT I
IF:
0
Papers:
20
Citations:
0

Organization

C
comsats university islamabad (cui)
Scholars:
1.1W
Papers: 1.1W
Citations: 7
U
university of technology sydney
Scholars:
1.6W
Papers: 2.0W
Citations: 25
Cited Papers

Cited Papers

Generative Adversarial Networks in Medical Image augmentation: A review
err2022-05-01
err196
PREAI
errChen, Yizhou; Yang, Xu-Hua; Wei, Zihan; Heidari, Ali Asghar; Zheng, Nenggan; Li, Zhicheng; Chen, Huiling; Hu, Haigen; Zhou, Qianwei; Guan, Qiu
errShare
errSave
errShare
errSave
errShare
errSave
Shifting to machine supervision: annotation-efficient semi and self-supervised learning for automatic medical image segmentation and classification
err2024-05-11
err2
errOAAI
errSingh, Pranav; Chukkapalli, Raviteja; Chaudhari, Shravan; Chen, Luoyao; Chen, Mei; Pan, Jinqian; Smuda, Craig; Cirrone, Jacopo
errShare
errSave
errShare
errSave
A review of uncertainty quantification in deep learning: Techniques, applications and challenges
err2021-12-01
err1.2K
errOAAI
errAbdar, Moloud; Pourpanah, Farhad; Hussain, Sadiq; Rezazadegan, Dana; Liu, Li; Ghavamzadeh, Mohammad; Fieguth, Paul; Cao, Xiaochun; Khosravi, Abbas; Acharya, U. Rajendra; Makarenkov, Vladimir; Nahavandi, Saeid
errShare
errSave
Efficient Deep Network Architectures for Fast Chest X-Ray Tuberculosis Screening and Visualization
err2019-04-18
err197
errOAAI
errPasa, F.; Golkov, V.; Pfeiffer, F.; Cremers, D.; Pfeiffer, D.
errShare
errSave
researcher View more