arrow
返回

Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification

delete2020-09-01
delete165
delete
OA
AI
A
Amirreza Mahbod *
G
Gerald Schaefer
C
Chunliang Wang
G
Georg Dorffner
R
Rupert Ecker
I
Isabella Ellinger
DOI:10.1016/j.cmpb.2020.105475delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Background and objective: Skin cancer is among the most common cancer types in the white population and consequently computer aided methods for skin lesion classification based on dermoscopic images are of great interest. A promising approach for this uses transfer learning to adapt pre-trained convolutional neural networks (CNNs) for skin lesion diagnosis. Since pre-training commonly occurs with natural images of a fixed image resolution and these training images are usually significantly smaller than dermoscopic images, downsampling or cropping of skin lesion images is required. This however may result in a loss of useful medical information, while the ideal resizing or cropping factor of dermoscopic images for the fine-tuning process remains unknown. Methods: We investigate the effect of image size for skin lesion classification based on pre-trained CNNs and transfer learning. Dermoscopic images from the International Skin Imaging Collaboration (ISIC) skin lesion classification challenge datasets are either resized to or cropped at six different sizes ranging from 224 x 224 to 450 x 450. The resulting classification performance of three well established CNNs, namely EfficientNetB0, EfficientNetB1 and SeReNeXt-50 is explored. We also propose and evaluate a multi-scale multi-CNN (MSM-CNN) fusion approach based on a three-level ensemble strategy that utilises the three network architectures trained on cropped dermoscopic images of various scales. Results: Our results show that image cropping is a better strategy compared to image resizing delivering superior classification performance at all explored image scales. Moreover, fusing the results of all three fine-tuned networks using cropped images at all six scales in the proposed MSM-CNN approach boosts the classification performance compared to a single network or a single image scale. On the ISIC 2018 skin lesion classification challenge test set, our MSM-CNN algorithm yields a balanced multi-class accuracy of 86.2% making it the currently second ranked algorithm on the live leaderboard. Conclusions: We confirm that the image size has an effect on skin lesion classification performance when employing transfer learning of CNNs. We also show that image cropping results in better performance compared to image resizing. Finally, a straightforward ensembling approach that fuses the results from images cropped at six scales and three fine-tuned CNNs is shown to lead to the best classification performance. (C) 2020 Elsevier B.V. All rights reserved.
Keyword:
Skin cancer
Dermoscopy
Medical image analysis
Deep learning
Image resolution
Image cropping
Transfer learning
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Computer Methods and Programs in Biomedicine 封面图
Computer Methods and Programs in Biomedicine
IF:
4.8
论文数:
7.0K
被引数:
2.1W

机构

L
Loughborough University
学者数:
9.9K
论文数: 1.0W
被引数: 1.3W
M
Medical University of Vienna
学者数:
3.7W
论文数: 2.5W
被引数: 3.1W
R
Royal Institute of Technology
学者数:
1.8W
论文数: 1.8W
被引数: 25
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
err分享
err收藏
Deep Learning and Handcrafted Method Fusion: Higher Diagnostic Accuracy for Melanoma Dermoscopy Images
err2019-07-01
err132
PREAI
errHagerty, Jason R.; Stanley, R. Joe; Almubarak, Haidar A.; Lama, Norsang; Kasmi, Reda; Guo, Peng; Drugge, Rhett J.; Rabinovitz, Harold S.; Oliviero, Margaret; Stoecker, William V.
err分享
err收藏
Availability of digital dermoscopy in daily practice dramatically reduces the number of excised melanocytic lesions: results from an observational study
err2012-08-20
err66
PREAI
errTromme, I.; Sacre, L.; Hammouch, F.; Legrand, C.; Marot, L.; Vereecken, P.; Theate, I.; van Eeckhout, P.; Richez, P.; Baurain, J. F.; Thomas, L.; Speybroeck, N.
err分享
err收藏
ImageNet Large Scale Visual Recognition ChallengeImageNet大规模视觉识别挑战
err2015-04-11
err2.7W
PREAI
errRussakovsky, Olga; Deng, Jia; Su, Hao; Krause, Jonathan; Satheesh, Sanjeev; Ma, Sean; Huang, Zhiheng; Karpathy, Andrej; Khosla, Aditya; Bernstein, Michael; Berg, Alexander C.; Fei-Fei, Li
err分享
err收藏
Skin Cancer Classification Using Convolutional Neural Networks: Systematic Review
err2018-10-17
err224
errOAAI
errBrinker, Titus Josef; Hekler, Achim; Utikal, Jochen Sven; Grabe, Niels; Schadendorf, Dirk; Klode, Joachim; Berking, Carola; Steeb, Theresa; Enk, Alexander H.; von Kalle, Christof
err分享
err收藏
Fusing fine-tuned deep features for skin lesion classification
err2019-01-01
err146
errOAAI
errMahbod, Amirreza; Schaefer, Gerald; Effinger, Isabella; Ecker, Rupert; Pitiot, Alain; Wang, Chunliang
err分享
err收藏
Melanoma
errLANCET
IF88.5
err2018-09-01
err1.1K
PREAI
errSchadendorf, Dirk; van Akkooi, Alexander C. J.; Berking, Carola; Griewank, Klaus G.; Gutzmer, Ralf; Hauschild, Axel; Stang, Andreas; Roesch, Alexander; Ugurel, Selma
err分享
err收藏
学者 查看更多内容