.png){kind=icon}
返回
StAlK: Structural Alignment based Self Knowledge distillation for Medical Image Classification
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2024.112503.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In the realm of medical image analysis, where challenges like high class imbalance, inter-class similarity, and intra-class variance are prevalent, knowledge distillation has emerged as a powerful mechanism for model compression and regularization. Existing methodologies, including label smoothening, contrastive learning, and relational knowledge transfer, aim to address these challenges but exhibit limitations in effectively managing either class imbalance or intricate inter and intra-class relations within input samples. In response, this paper introduces StAlK (Structural St ructural Al ignment based Self K nowledge distillation) for Medical Image Classification, a novel approach which leverages the alignment of complex high-order discriminative features from a mean teacher model. This alignment enhances the student model's ability to distinguish examples across different classes. StAlK demonstrates superior performance in scenarios involving both inter and intra-class relationships and proves significantly more robust in handling class imbalance compared to baseline methods. Extensive investigations across multiple benchmark datasets reveal that StAlK achieves a substantial improvement of 6%-7% in top-1 accuracy compared to various state-of-the-art baselines. The code is available at: https: //github.com/philsaurabh/StAlK_KBS.
Keyword:
Knowledge distillation
Class imbalance
Inter and intra class relations
Medical image classification
Graph structure learning
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
HIRE: Distilling high-order relational knowledge from heterogeneous graph neural networksHIRE: 从异构图神经网络中提取高阶关系知识.png)
NEUROCOMPUTING
OAAI
NEUROCOMPUTINGIF6.5
OAAI分享收藏SSD-KD: A self-supervised diverse knowledge distillation method for lightweight skin lesion classification using dermoscopic imagesMEDICAL IMAGE ANALYSIS
OAAI
MEDICAL IMAGE ANALYSISIF11.8
OAAI分享收藏
查看更多内容