arrow
Return

Image Classification With Small Datasets: Overview and Benchmark

delete2022-01-01
delete15
delete
OA
AI
L
Lorenzo Brigato *
B
Björn Barz
L
Luca Iocchi
J
Joachim Denzler
DOI:10.1109/ACCESS.2022.3172939delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Image classification with small datasets has been an active research area in the recent past. However, as research in this scope is still in its infancy, two key ingredients are missing for ensuring reliable and truthful progress: a systematic and extensive overview of the state of the art, and a common benchmark to allow for objective comparisons between published methods. This article addresses both issues. First, we systematically organize and connect past studies to consolidate a community that is currently fragmented and scattered. Second, we propose a common benchmark that allows for an objective comparison of approaches. It consists of five datasets spanning various domains (e.g., natural images, medical imagery, satellite data) and data types (RGB, grayscale, multispectral). We use this benchmark to re-evaluate the standard cross-entropy baseline and ten existing methods published between 2017 and 2021 at renowned venues. Surprisingly, we find that thorough hyper-parameter tuning on held-out validation data results in a highly competitive baseline and highlights a stunted growth of performance over the years. Indeed, only a single specialized method dating back to 2019 clearly wins our benchmark and outperforms the baseline classifier.
Keywords:
Benchmark testing
Training
Image classification
Task analysis
Neural networks
Satellites
Optimization
Data-efficiency
image classification
benchmark
neural networks
small datasets

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

F
Friedrich Schiller University of Jena
Scholars:
1.9W
Papers: 1.5W
Citations: 25
S
sapienza university rome
Scholars:
6.3W
Papers: 4.7W
Citations: 381