arrow
返回

Segmentation ability map: Interpret deep features for medical image segmentation

delete2023-02-01
delete9
delete
OA
AI
S
Sheng He
Y
Yanfang Feng
P
P. Ellen Grant
Y
Yangming Ou *
DOI:10.1016/j.media.2022.102726delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep convolutional neural networks (CNNs) have been widely used for medical image segmentation. In most studies, only the output layer is exploited to compute the final segmentation results and the hidden representations of the deep learned features have not been well understood. In this paper, we propose a prototype segmentation (ProtoSeg) method to compute a binary segmentation map based on deep features. We measure the segmentation abilities of the features by computing the Dice between the feature segmentation map and ground-truth, named as the segmentation ability score (SA score for short). The corresponding SA score can quantify the segmentation abilities of deep features in different layers and units to understand the deep neural networks for segmentation. In addition, our method can provide a mean SA score which can give a performance estimation of the output on the test images without ground-truth. Finally, we use the proposed ProtoSeg method to compute the segmentation map directly on input images to further understand the segmentation ability of each input image. Results are presented on segmenting tumors in brain MRI, lesions in skin images, COVID-related abnormality in CT images, prostate segmentation in abdominal MRI, and pancreatic mass segmentation in CT images. Our method can provide new insights for interpreting and explainable AI systems for medical image segmentation. Our code is available on: https://github.com/shengfly/ProtoSeg.
Keyword:
Medical image segmentation
Prototype segmentation
U-net
Interpreting and explainable AI

期刊

Medical Image Analysis 封面图
Medical Image Analysis
IF:
11.8
论文数:
3.9K
被引数:
2.4W

机构

H
Harvard University
学者数:
26.5W
论文数: 22.0W
被引数: 28.7W
引用论文

引用论文

Application of Distributed Intelligence to Industrial Demand Response
err2016-08-23
err0
PREAI
errChun S. Lai; Fangyuan Xu; Malcolm McCulloch; Loi L. Lai
err分享
err收藏
err分享
err收藏
The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)多模态脑肿瘤图像分割基准 (BRATS)
err2015-10-01
err3.7K
errOAAI
errMenze, Bjoern H.; Jakab, Andras; Bauer, Stefan; Kalpathy-Cramer, Jayashree; Farahani, Keyvan; Kirby, Justin; Burren, Yuliya; Porz, Nicole; Slotboom, Johannes; Wiest, Roland; Lanczi, Levente; Gerstner, Elizabeth; Weber, Marc-Andre; Arbel, Tal; Avants, Brian B.; Ayache, Nicholas; Buendia, Patricia; Collins, D. Louis; Cordier, Nicolas; Corso, Jason J.; Criminisi, Antonio; Das, Tilak; Delingette, Herve; Demiralp, Cagatay; Durst, Christopher R.; Dojat, Michel; Doyle, Senan; Festa, Joana; Forbes, Florence; Geremia, Ezequiel; Glocker, Ben; Golland, Polina; Guo, Xiaotao; Hamamci, Andac; Iftekharuddin, Khan M.; Jena, Raj; John, Nigel M.; Konukoglu, Ender; Lashkari, Danial; Mariz, Jose Antonio; Meier, Raphael; Pereira, Sergio; Precup, Doina; Price, Stephen J.; Raviv, Tammy Riklin; Reza, Syed M. S.; Ryan, Michael; Sarikaya, Duygu; Schwartz, Lawrence; Shin, Hoo-Chang; Shotton, Jamie; Silva, Carlos A.; Sousa, Nuno; Subbanna, Nagesh K.; Szekely, Gabor; Taylor, Thomas J.; Thomas, Owen M.; Tustison, Nicholas J.; Unal, Gozde; Vasseur, Flor; Wintermark, Max; Ye, Dong Hye; Zhao, Liang; Zhao, Binsheng; Zikic, Darko; Prastawa, Marcel; Reyes, Mauricio; Van Leemput, Koen
err分享
err收藏
Attention gated networks: Learning to leverage salient regions in medical images注意门控网络: 学习利用医学图像中的显着区域
err2019-04-01
err1.1K
errOAAI
errSchlemper, Jo; Oktay, Ozan; Schaap, Michiel; Heinrich, Mattias; Kainz, Bernhard; Glocker, Ben; Rueckert, Daniel
err分享
err收藏
Concept whitening for interpretable image recognition
err2020-12-07
err165
errOAAI
errChen, Zhi; Bei, Yijie; Rudin, Cynthia
err分享
err收藏
Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI可解释人工智能 (XAI): 负责任人工智能的概念、分类、机遇和挑战
err2020-06-01
err3.9K
errOAAI
errBarredo Arrieta, Alejandro; Diaz-Rodriguez, Natalia; Del Ser, Javier; Bennetot, Adrien; Tabik, Siham; Barbado, Alberto; Garcia, Salvador; Gil-Lopez, Sergio; Molina, Daniel; Benjamins, Richard; Chatila, Raja; Herrera, Francisco
err分享
err收藏
Self-co-attention neural network for anatomy segmentation in whole breast ultrasound
err2020-08-01
err50
PREAI
errLei, Baiying; Huang, Shan; Li, Hang; Li, Ran; Bian, Cheng; Chou, Yi-Hong; Qin, Jing; Zhou, Peng; Gong, Xuehao; Cheng, Jie-Zhi
err分享
err收藏
err分享
err收藏
err分享
err收藏
学者 查看更多内容