arrow
Return

Self-Supervised Learning Methods for Label-Efficient Dental Caries Classification

delete2022-05-16
delete14
delete
OA
AI
A
Aiham Taleb *
C
Csaba Rohrer
B
Benjamin Bergner
G
Guilherme De Leon
J
Jonas Almeida Rodrigues
F
Falk Schwendicke
C
Christoph Lippert
J
Joachim Krois
DOI:10.3390/diagnostics12051237delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
High annotation costs are a substantial bottleneck in applying deep learning architectures to clinically relevant use cases, substantiating the need for algorithms to learn from unlabeled data. In this work, we propose employing self-supervised methods. To that end, we trained with three self-supervised algorithms on a large corpus of unlabeled dental images, which contained 38K bitewing radiographs (BWRs). We then applied the learned neural network representations on tooth-level dental caries classification, for which we utilized labels extracted from electronic health records (EHRs). Finally, a holdout test-set was established, which consisted of 343 BWRs and was annotated by three dental professionals and approved by a senior dentist. This test-set was used to evaluate the fine-tuned caries classification models. Our experimental results demonstrate the obtained gains by pretraining models using self-supervised algorithms. These include improved caries classification performance (6 p.p. increase in sensitivity) and, most importantly, improved label-efficiency. In other words, the resulting models can be fine-tuned using few labels (annotations). Our results show that using as few as 18 annotations can produce >= 45% sensitivity, which is comparable to human-level diagnostic performance. This study shows that self-supervision can provide gains in medical image analysis, particularly when obtaining labels is costly and expensive.
Keywords:
unsupervised methods
self-supervised learning
representation learning
dental caries classification
data driven approaches
annotation efficient deep learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Diagnostics cover
Diagnostics
IF:
3.3
Papers:
1.9W
Citations:
3.6W

Organization

B
Berlin Institute of Health
Scholars:
3.9W
Papers: 3.0W
Citations: 6.6K
F
Free University of Berlin
Scholars:
3.8W
Papers: 3.2W
Citations: 51
U
University of Potsdam
Scholars:
7.8K
Papers: 7.1K
Citations: 1.4W
H
Humboldt University of Berlin
Scholars:
3.2W
Papers: 2.7W
Citations: 47
researcher View more organizations