arrow
Return

Efficient adaptive ensembling for image classification

delete2023-08-29
delete3
delete
OA
AI
A
Antonio Bruno
D
Davide Moroni
M
Massimo Martinelli *
DOI:10.1111/exsy.13424delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
In recent times, with the exception of sporadic cases, the trend in computer vision is to achieve minor improvements compared to considerable increases in complexity. To reverse this trend, we propose a novel method to boost image classification performances without increasing complexity. To this end, we revisited ensembling, a powerful approach, often not used properly due to its more complex nature and the training time, so as to make it feasible through a specific design choice. First, we trained two EfficientNet-b0 end-to-end models (known to be the architecture with the best overall accuracy/complexity trade-off for image classification) on disjoint subsets of data (i.e., bagging). Then, we made an efficient adaptive ensemble by performing fine-tuning of a trainable combination layer. In this way, we were able to outperform the state-of-the-art by an average of 0.5% on the accuracy, with restrained complexity both in terms of the number of parameters (by 5-60 times), and the FLoating point Operations Per Second FLOPS by 10-100 times on several major benchmark datasets.
Keywords:
convolutional neural networks
deep learning
EfficientNet
ensemble
image classification

Journal

Expert Systems cover
Expert Systems
IF:
2.3
Papers:
2.5K
Citations:
3.8K

Organization

C
consiglio nazionale delle ricerche (cnr)
Scholars:
6.2W
Papers: 5.7W
Citations: 48
Cited Papers

Cited Papers

High prevalence of malaria in a non-endemic setting among febrile episodes in travellers and migrants coming from endemic areas: a retrospective analysis of a 2013–2018 cohort
err2021-11-27
err0
errOAAI
errAlejandro Garcia-Ruiz de Morales; Covadonga Morcate; Elena Isaba-Ares; Ramon Perez-Tanoira; Jose A. Perez-Molina
errShare
errSave
Vision in Multiple Sclerosis
err2011-12-01
err0
errOAAI
errReiko E. Sakai; Daniel J. Feller; Kristin M. Galetta; Steven L. Galetta; Laura J. Balcer
errShare
errSave
Synthesis of n-type semiconducting diamond film using diphosphorus pentaoxide as the doping source
err1990-10-01
err0
PREAI
errKen Okano; Hideo Kiyota; Tatsuya Iwasaki; Yoshitaka Nakamura; Yukio Akiba; Tateki Kurosu; Masamori Iida; Terutaro Nakamura
errShare
errSave
Role of simple descriptors and applicability domain in predicting change in protein thermostability
err2018-09-07
err0
errOAAI
errKenneth N. McGuinness; Weilan Pan; Robert P. Sheridan; Grant Murphy; Alejandro Crespo
errShare
errSave
Further development of a test method for the assessment of the acute inhalation toxicity of combustion products
err
IF0
err1982-01-01
err0
errOAAI
errBarbara C Levin; Andrew J Fowell; Merritt M Birky; Maya Paabo; Alan Stolte; Dolores Malek
errShare
errSave
researcher View more