arrow
返回

Efficient Medical Image Segmentation Based on Knowledge Distillation

delete2021-12-01
delete85
delete
OA
AI
D
Dian Qin
J
Jiajun Bu *
Z
Zhe Liu
X
Xin Shen
S
Sheng Zhou
J
Jingjun Gu
Z
Zhihua Wang
L
Lei Wu
DOI:10.1109/TMI.2021.3098703delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Recent advances have been made in applying convolutional neural networks to achieve more precise prediction results for medical image segmentation problems. However, the success of existing methods has highly relied on huge computational complexity and massive storage, which is impractical in the real-world scenario. To deal with this problem, we propose an efficient architecture by distilling knowledge from well-trained medical image segmentation networks to train another lightweight network. This architecture empowers the lightweight network to get a significant improvement on segmentation capability while retaining its runtime efficiency. We further devise a novel distillation module tailored for medical image segmentation to transfer semantic region information from teacher to student network. It forces the student network to mimic the extent of difference of representations calculated from different tissue regions. This module avoids the ambiguous boundary problem encountered when dealing with medical imaging but instead encodes the internal information of each semantic region for transferring. Benefited from our module, the lightweight network could receive an improvement of up to 32.6% in our experiment while maintaining its portability in the inference phase. The entire structure has been verified on two widely accepted public CT datasets LiTS17 and KiTS19. We demonstrate that a lightweight network distilled by our method has non-negligible value in the scenario which requires relatively high operating speed and low storage usage.
Keyword:
Image segmentation
Biomedical imaging
Semantics
Knowledge engineering
Feature extraction
Tumors
Computer architecture
Knowledge distillation
medical image segmentation
computerized tomography
lightweight neural network
transfer learning

期刊

IEEE Transactions on Medical Imaging 封面图
IEEE Transactions on Medical Imaging
IF:
9.8
论文数:
6.3K
被引数:
3.7W

机构

Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

err分享
err收藏
Real-Time Polyp Detection, Localization and Segmentation in Colonoscopy Using Deep Learning基于深度学习的结肠镜实时息肉检测、定位和分割
err2021-01-01
err185
errOAAI
errJha, Debesh; Ali, Sharib; Tomar, Nikhil Kumar; Johansen, Havard D.; Johansen, Dag; Rittscher, Jens; Riegler, Michael A.; Halvorsen, Pal
err分享
err收藏
Contamination of polychlorinated biphenyls and organochlorine pesticides in breast milk in Korea: Time-course variation, influencing factors, and exposure assessment
err2013-11-01
err0
PREAI
errSunggyu Lee; Sunmi Kim; Hyun-Kyung Lee; In-Seok Lee; Jeongim Park; Hai-Joong Kim; Jeong Jae Lee; Gyuyeon Choi; Sooran Choi; Sungjoo Kim; Su Young Kim; Kyungho Choi; Sungkyoon Kim; Hyo-Bang Moon
err分享
err收藏
err分享
err收藏
err分享
err收藏
Species differences in the disposition of inhaled butadiene
err1986-07-01
err0
PREAI
errJames A. Bond; Alan R. Dahl; Rogene F. Henderson; John S. Dutcher; Joe L. Mauderly; Linda S. Birnbaum
err分享
err收藏
学者 查看更多内容