arrow
返回

Explainable Knowledge Distillation for On-Device Chest X-Ray Classification

delete2024-07-01
delete2
delete
OA
AI
C
Chakkrit Termritthikun
A
Ayaz Umer
S
Suwichaya Suwanwimolkul
F
Feng Xia
I
Ivan Lee *
DOI:10.1109/TCBB.2023.3272333delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Automated multi-label chest X-rays (CXR) image classification has achieved substantial progress in clinical diagnosis via utilizing sophisticated deep learning approaches. However, most deep models have high computational demands, which makes them less feasible for compact devices with low computational requirements. To overcome this problem, we propose a knowledge distillation (KD) strategy to create the compact deep learning model for the real-time multi-label CXR image classification. We study different alternatives of CNNs and Transforms as the teacher to distill the knowledge to a smaller student. Then, we employed explainable artificial intelligence (XAI) to provide the visual explanation for the model decision improved by the KD. Our results on three benchmark CXR datasets show that our KD strategy provides the improved performance on the compact student model, thus being the feasible choice for many limited hardware platforms. For instance, when using DenseNet161 as the teacher network, EEEA-Net-C2 achieved an AUC of 83.7%, 87.1%, and 88.7% on the ChestX-ray14, CheXpert, and PadChest datasets, respectively, with fewer parameters of 4.7 million and computational cost of 0.3 billion FLOPS.
Keyword:
Computational modeling
Transformers
Diseases
Deep learning
Computer architecture
Artificial intelligence
Image classification
Knowledge distillation
chest X-ray
explainable artificial intelligence
on-device

期刊

I
IEEE-ACM Transactions on Computational Biology and Bioinformatics
IF:
3.4
论文数:
3.3K
被引数:
6.4K

机构

N
naresuan university
学者数:
2.1K
论文数: 1.5K
被引数: 2
U
University of South Australia
学者数:
9.0K
论文数: 1.1W
被引数: 1.6W
引用论文

引用论文

Lithocholic acid down-regulation of NF-κB activity through vitamin D receptor in colonic cancer cells
err2008-07-01
err0
errOAAI
errJun Sun; Reba Mustafi; Sonia Cerda; Anusara Chumsangsri; Yinglin Rick Xia; Yan Chun Li; Marc Bissonnette
err分享
err收藏
Validation and clinical relevance of a novel scalp coverage scoring method
err2003-01-20
err0
PREAI
errDominique Van Neste; Thérèse Leroy; Emmanuelle Sandraps
err分享
err收藏
Evolution of the COPD Assessment Test Score during Chronic Obstructive Pulmonary Disease Exacerbations: Determinants and Prognostic Value
err2013-01-01
err0
errOAAI
errDarwin Feliz-Rodriguez; Santiago Zudaire; Carlos Carpio; Elizabet Martínez; Antonia Gómez-Mendieta; Ana Santiago; Rodolfo Alvarez-Sala; Francisco García-Río
err分享
err收藏
A Survey on Evolutionary Neural Architecture Search
err2023-02-01
err255
errOAAI
errLiu, Yuqiao; Sun, Yanan; Xue, Bing; Zhang, Mengjie; Yen, Gary G.; Tan, Kay Chen
err分享
err收藏
Deep learning for chest X-ray analysis: A survey胸部x线分析的深度学习: 一项调查
err2021-08-01
err209
errOAAI
errcalli, Erdi; Sogancioglu, Ecem; van Ginneken, Bram; van Leeuwen, Kicky G.; Murphy, Keelin
err分享
err收藏
Methylprednisolone plus diazepam i.v. as bridge therapy for medication overuse headache
err2017-09-06
err0
PREAI
errMatteo Paolucci; Claudia Altamura; Nicoletta Brunelli; Angelo Cascio Rizzo; Federica Assenza; Patrizio Pasqualetti; Fabrizio Vernieri
err分享
err收藏
学者 查看更多内容