arrow
Return

Explainable Image Recognition With Graph-Based Feature Extraction

delete2024-01-01
delete0
delete
OA
AI
B
Basim Azam *
D
Deepthi Kuttichira
B
Brijesh Verma
A
Ashfaqur Rahman
L
Lipo Wang *
DOI:10.1109/ACCESS.2024.3475380delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Deep learning models have proven remarkably adept at extracting salient features from raw data, driving state-of-the-art performance across many domains. However, these models suffer from a lack of interpretability; they function as black boxes, obscuring the feature-level support of their predictions. Addressing this problem, we introduce a novel framework that combines the strengths of convolutional layers in extracting features with the adaptability of Graph Neural Networks (GNNs) to effectively represent the interconnections among neuron activations. Our framework operates in two phases: first, it identifies class-oriented neuron activations by analyzing image features, then these activations are encapsulated within a graph structure. The GNN in our system utilizes the connections between neuron activations to yield an interpretable final classification. This approach allows for the backtracking of predictions to identify key contributing neurons, enhancing the model's explainability. The proposed model not only matches, but at times exceeds, the accuracy of current leading models, all the while providing transparency via class-specific feature importance. This novel integration of convolutional and graph neural networks offers a significant step towards interpretable and accountable deep learning models.
Keywords:
Graph neural networks
convolutional neural networks
convolutional neural networks
deep learning
deep learning
deep learning

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

N
Nanyang Technological University
Scholars:
4.9W
Papers: 4.8W
Citations: 8.1W
G
Griffith University
Scholars:
1.5W
Papers: 1.6W
Citations: 2.5W
researcher View more organizations