arrow
Return

Cervical Cell Image Classification-Based Knowledge Distillation

delete2022-11-10
delete10
delete
OA
AI
W
Wenjian Gao
徐
徐传运 (Chuanyun Xu) *
G
Gang Li *
张
张杨 (Yang Zhang)
N
Nanlan Bai
M
Mengwei Li
DOI:10.3390/biomimetics7040195delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Current deep-learning-based cervical cell classification methods suffer from parameter redundancy and poor model generalization performance, which creates challenges for the intelligent classification of cervical cytology smear images. In this paper, we establish a method for such classification that combines transfer learning and knowledge distillation. This new method not only transfers common features between different source domain data, but also realizes model-to-model knowledge transfer using the unnormalized probability output between models as knowledge. A multi-exit classification network is then introduced as the student network, where a global context module is embedded in each exit branch. A self-distillation method is then proposed to fuse contextual information; deep classifiers in the student network guide shallow classifiers to learn, and multiple classifier outputs are fused using an average integration strategy to form a classifier with strong generalization performance. The experimental results show that the developed method achieves good results using the SIPaKMeD dataset. The accuracy, sensitivity, specificity, and F-measure of the five classifications are 98.52%, 98.53%, 98.68%, 98.59%, respectively. The effectiveness of the method is further verified on a natural image dataset.
Keywords:
deep learning
cervical cells
image classification
transfer learning
knowledge distillation
self-distillation
context information
ensemble
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

B
Biomimetics
IF:
3.9
Papers:
3.2K
Citations:
5.1K

Organization

C
Chongqing University of Technology
Scholars:
5.8K
Papers: 3.5K
Citations: 3
C
Chongqing Normal University
Scholars:
3.3K
Papers: 2.7K
Citations: 3.8K
Cited Papers

Cited Papers

DeepPap: Deep Convolutional Networks for Cervical Cell Classification
err2017-11-01
err291
errOAAI
errZhang, Ling; Lu, Le; Nogues, Isabella; Summers, Ronald M.; Liu, Shaoxiong; Yao, Jianhua
errShare
errSave
Knowledge Distillation: A Survey
err2021-03-22
err1.5K
PREAI
errGou, Jianping; Yu, Baosheng; Maybank, Stephen J.; Tao, Dacheng
errShare
errSave
errShare
errSave
Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries
err2018-09-12
err1.9K
errOAAI
errBray, Freddie; Ferlay, Jacques; Soerjomataram, Isabelle; Siegel, Rebecca L.; Torre, Lindsey A.; Jemal, Ahmedin
errShare
errSave
The structure of influenza virus
err1970-12-01
err0
PREAI
errIrene T. Schulze
errShare
errSave
errShare
errSave
researcher View more