arrow
Return

Multiple Instance Learning Using 3D Features for Melanoma Detection

delete2022-01-01
delete3
delete
OA
AI
P
Pedro M. M. Pereira *
L
Lucas A. Thomaz
L
L. Tavora
P
Pedro Assunção
R
Rui Fonseca-Pinto
R
Rui Pedro Paiva
S
Sérgio M. M. de Faria
DOI:10.1109/ACCESS.2022.3192444delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This work presents a contribution to advance current solutions for the problem of melanoma detection based on deep learning (DL) approaches. This is an active research field, which aims to aid on the detection and classification of melanoma (the most lethal type of skin cancer) with non-invasive solutions. By exploiting both 2D and 3D characteristics of the skin lesion surface, the proposed approach advances beyond commonly used colour features of dermoscopic images. Two competing classification methods are exploited, namely Multiple Instance Learning (MIL) and DL, which are combined using an uncertainty-aware decision function. The DL method performs classification resorting to RGB data, while MIL performs 3D feature extraction, selects the most significant set, and performs classification at two different learning instances. The novel aspects of this work include DL uncertainty evaluation mechanisms along with MIL to train a robust ensemble classifier, and also the use of dense light-fields for skin lesion classification. Despite the large class imbalance (often present in medical image datasets), the ensemble model achieves cross-validated melanoma classification accuracy of 84.00% when trained against nevus lesions, and 90.82% accuracy when discriminating against all present lesion types. The results show that, in the absence of discriminative 2D characteristics, the 3D surface provides redeeming results, demonstrating that existing methods can benefit from the proposed method by looking beyond 2D image characteristics.
Keywords:
Lesions
Feature extraction
Three-dimensional displays
Skin
Melanoma
Uncertainty
Image color analysis
3D features
classification
light-fields
medical image analysis
melanoma
skin lesion

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
universidade de coimbra
Scholars:
1.9W
Papers: 1.6W
Citations: 16