arrow
Return

A self-interpretable module for deep image classification on small data

delete2022-08-05
delete5
delete
OA
AI
B
Biagio La Rosa *
R
Roberto Capobianco
D
Daniele Nardi
DOI:10.1007/s10489-022-03886-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep neural networks are the driving force of the recent explosion of machine learning applications in everyday life. However, they usually require a lot of training data to work well, and they act as black-boxes, making predictions without any explanation about them. This paper presents Memory Wrap, a module (i.e, a set of layers) that can be added to deep learning models to improve their performance and interpretability in settings where few data are available. Memory Wrap adopts a sparse content-attention mechanism between the input and some memories of past training samples. We show that adding Memory Wrap to standard deep neural networks improves their performance when they learn from a limited set of data, and allows them to reach comparable performance when they learn from the full dataset. We discuss how the analysis of its structure and content-attention weights helps to get insights about its decision process and makes their predictions more interpretable, compared to the same networks without Memory Wrap. We test our approach on image classification tasks using several networks on three different datasets, namely CIFAR10, SVHN, and CINIC10.
Keywords:
Interpretable deep learning
eXplainable Artificial Intelligence
Memory augmented neural networks
Small data

Journal

Applied Intelligence cover
Applied Intelligence
IF:
3.5
Papers:
7.6K
Citations:
1.7W

Organization

S
sapienza university rome
Scholars:
6.3W
Papers: 4.7W
Citations: 381
Cited Papers

Cited Papers

Chronic inflammatory demyelinating polyradiculoneuropathy with diffuse and massive peripheral nerve hypertrophy: Distinctive clinical and magnetic resonance imaging features
err1998-06-01
err0
PREAI
errKeiko Mizuno; Masaaki Nagamatsu; Naoki Hattori; Masahiki Yamamoto; Hiroshi Goto; Kazumasa Kuniyoshi; Gen Sobue
errShare
errSave
Genetic Diversity in Insect Metal Tolerance
err2017-11-07
err0
errOAAI
errThomas J. S. Merritt; Adam J. Bewick
errShare
errSave
Opportunities and obstacles for deep learning in biology and medicine
err2018-04-04
err1.3K
errOAAI
errChing, Travers; Himmelstein, Daniel S.; Beaulieu-Jones, Brett K.; Kalinin, Alexandr A.; Do, Brian T.; Way, Gregory P.; Ferrero, Enrico; Agapow, Paul-Michael; Zietz, Michael; Hoffman, Michael M.; Xie, Wei; Rosen, Gail L.; Lengerich, Benjamin J.; Israeli, Johnny; Lanchantin, Jack; Woloszynek, Stephen; Carpenter, Anne E.; Shrikumar, Avanti; Xu, Jinbo; Cofer, Evan M.; Lavender, Christopher A.; Turaga, Srinivas C.; Alexandari, Amr M.; Lu, Zhiyong; Harris, David J.; DeCaprio, Dave; Qi, Yanjun; Kundaje, Anshul; Peng, Yifan; Wiley, Laura K.; Segler, Marwin H. S.; Boca, Simina M.; Swamidass, S. Joshua; Huang, Austin; Gitter, Anthony; Greene, Casey S.
errShare
errSave
Modification of function in head-injured patients with Sinemet
err2009-07-03
err0
PREAI
errSantosh Lal; Charles P. Merbtiz; Jeffrey C. Grip
errShare
errSave
Comparison of trauma-focused cognitive behavioral therapy and theory of mind: Improvement of posttraumatic growth and emotion regulation strategies
err2018-01-01
err0
errOAAI
errSafora Salemi; Vahid Farnia; Abdulzahra Naami; Yadollah Zargar; Iran Davoodi; Faezeh Tatari; Ashraf Kazemi; Behrad Basanj; TourajAhmadi Jouybari; Mostafa Alikhani
errShare
errSave
researcher View more