arrow
返回

A self-interpretable module for deep image classification on small data

delete2022-08-05
delete5
delete
OA
AI
B
Biagio La Rosa *
R
Roberto Capobianco
D
Daniele Nardi
DOI:10.1007/s10489-022-03886-6delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep neural networks are the driving force of the recent explosion of machine learning applications in everyday life. However, they usually require a lot of training data to work well, and they act as black-boxes, making predictions without any explanation about them. This paper presents Memory Wrap, a module (i.e, a set of layers) that can be added to deep learning models to improve their performance and interpretability in settings where few data are available. Memory Wrap adopts a sparse content-attention mechanism between the input and some memories of past training samples. We show that adding Memory Wrap to standard deep neural networks improves their performance when they learn from a limited set of data, and allows them to reach comparable performance when they learn from the full dataset. We discuss how the analysis of its structure and content-attention weights helps to get insights about its decision process and makes their predictions more interpretable, compared to the same networks without Memory Wrap. We test our approach on image classification tasks using several networks on three different datasets, namely CIFAR10, SVHN, and CINIC10.
Keyword:
Interpretable deep learning
eXplainable Artificial Intelligence
Memory augmented neural networks
Small data

期刊

Applied Intelligence 封面图
Applied Intelligence
IF:
3.5
论文数:
7.6K
被引数:
1.7W

机构

S
sapienza university rome
学者数:
6.3W
论文数: 4.7W
被引数: 381
引用论文

引用论文

Chronic inflammatory demyelinating polyradiculoneuropathy with diffuse and massive peripheral nerve hypertrophy: Distinctive clinical and magnetic resonance imaging features
err1998-06-01
err0
PREAI
errKeiko Mizuno; Masaaki Nagamatsu; Naoki Hattori; Masahiki Yamamoto; Hiroshi Goto; Kazumasa Kuniyoshi; Gen Sobue
err分享
err收藏
Genetic Diversity in Insect Metal Tolerance
err2017-11-07
err0
errOAAI
errThomas J. S. Merritt; Adam J. Bewick
err分享
err收藏
Opportunities and obstacles for deep learning in biology and medicine生物学和医学深度学习的机遇和障碍
err2018-04-04
err1.3K
errOAAI
errChing, Travers; Himmelstein, Daniel S.; Beaulieu-Jones, Brett K.; Kalinin, Alexandr A.; Do, Brian T.; Way, Gregory P.; Ferrero, Enrico; Agapow, Paul-Michael; Zietz, Michael; Hoffman, Michael M.; Xie, Wei; Rosen, Gail L.; Lengerich, Benjamin J.; Israeli, Johnny; Lanchantin, Jack; Woloszynek, Stephen; Carpenter, Anne E.; Shrikumar, Avanti; Xu, Jinbo; Cofer, Evan M.; Lavender, Christopher A.; Turaga, Srinivas C.; Alexandari, Amr M.; Lu, Zhiyong; Harris, David J.; DeCaprio, Dave; Qi, Yanjun; Kundaje, Anshul; Peng, Yifan; Wiley, Laura K.; Segler, Marwin H. S.; Boca, Simina M.; Swamidass, S. Joshua; Huang, Austin; Gitter, Anthony; Greene, Casey S.
err分享
err收藏
Modification of function in head-injured patients with Sinemet
err2009-07-03
err0
PREAI
errSantosh Lal; Charles P. Merbtiz; Jeffrey C. Grip
err分享
err收藏
Comparison of trauma-focused cognitive behavioral therapy and theory of mind: Improvement of posttraumatic growth and emotion regulation strategies
err2018-01-01
err0
errOAAI
errSafora Salemi; Vahid Farnia; Abdulzahra Naami; Yadollah Zargar; Iran Davoodi; Faezeh Tatari; Ashraf Kazemi; Behrad Basanj; TourajAhmadi Jouybari; Mostafa Alikhani
err分享
err收藏
学者 查看更多内容