arrow
Return

Interpretable Deep Image Classification Using Rationally Inattentive Utility Maximization

delete2024-03-01
delete1
PRE
AI
K
Kunal Pattanayak *
V
Vikram Krishnamurthy
A
Adit Jain
DOI:10.1109/JSTSP.2024.3381335delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Can deep convolutional neural networks (CNNs) for image classification be interpreted as utility maximizers with information costs? By performing set-valued system identification for Bayesian decision systems, we demonstrate that deep CNNs behave equivalently (in terms of necessary and sufficient conditions) to rationally inattentive Bayesian utility maximizers, a generative model used extensively in economics for human decision-making. Our claim is based on approximately 500 numerical experiments on 5 widely used neural network architectures. The parameters of the resulting interpretable model are computed efficiently via convex feasibility algorithms. As a practical application, we also illustrate how the reconstructed interpretable model can predict the classification performance of deep CNNs with high accuracy. The theoretical foundation of our approach lies in Bayesian revealed preference studied in micro-economics. All our results are on GitHub and completely reproducible.
Keywords:
Biological system modeling
Bayes methods
Costs
Computational modeling
Predictive models
Convolutional neural networks
Training
Interpretable machine learning
Bayesian revealed preference
rational inattention
deep neural networks
image classification

Journal

IEEE Journal of Selected Topics in Signal Processing cover
IEEE Journal of Selected Topics in Signal Processing
IF:
13.7
Papers:
1.9K
Citations:
1.1W

Organization

C
Cornell University
Scholars:
6.3W
Papers: 5.4W
Citations: 10.9W