arrow
Return

Enhancing concept-based image classification via knowledge reasoning

delete2026-02-09
delete0
delete
OA
AI
F
Franck Anaël Mbiaya
F
Frédéric Ros
C
Christel Vrain
T
Thi-Bich-Hanh Dao
Y
Yves Lucas
DOI:10.1016/j.knosys.2026.115509delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Deep learning has made great progress in supervised image classification. However, a persistent challenge in this field is the need for better explainability. This is crucial for building trust, troubleshooting, and ensuring regulatory compliance, ultimately leading to more responsible and effective AI applications. To tackle this challenge, we have developed a deep learning framework based on concepts, a recent method aimed at enhancing explainability, albeit with less emphasis on image classification performance. Our innovation lies in integrating a specific knowledge graph as a reasoning tool. This approach leverages the interdependence between concepts and classes to improve the performance of the concept-based model, achieving a balance between explainability and efficiency. Results from both synthetic and real data validate the effectiveness of our approach in balancing efficiency and explainability. Additionally, our model supports human test-time intervention to update its final prediction after incorporating new expert feedback. Our experiments show significant improvements in both classification and concept efficiencies.
Keywords:
Deep learning
Image classification
Rules
Knowledge graph
Explainable AI
Concept-based XAI
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

K
Knowledge-Based Systems
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

U
univ. orleans and insa centre val de loire
Scholars:
5
Papers: 1
Citations: 0
Cited Papers

Cited Papers

Semantic-based regularization for learning and inference
err2017-03-01
err104
PREAI
errDiligenti, Michelangelo; Gori, Marco; Sacca, Claudio
errShare
errSave
Explainable Methods for Image-Based Deep Learning: A Review
err2023-01-13
err14
PREAI
errGupta, Lav Kumar; Koundal, Deepika; Mongia, Shweta
errShare
errSave
Knowledge graph-based image classification
err2024-05-01
err0
PREAI
errMbiaya,Franck Anaël; Vrain,Christel; Ros,Frédéric; Dao,Thi-Bich-Hanh; Lucas,Yves
errShare
errSave
A Comprehensive Survey of Transformers for Computer Vision
errDRONES
IF4.8
err2023-04-25
err35
errOAAI
errJamil, Sonain; Piran, Md. Jalil; Kwon, Oh-Jin
errShare
errSave
Physics-Embedded Machine Learning: Case Study with Electrochemical Micro-Machining
err2017-01-17
err0
errOAAI
errYanfei Lu; Manik Rajora; Pan Zou; Steven Liang
errShare
errSave
Interactive Concept Bottleneck Models
err2023-06-26
err0
errOAAI
errKushal Chauhan; Rishabh Tiwari; Jan Freyberg; Pradeep Shenoy; Krishnamurthy Dvijotham
errShare
errSave
errShare
errSave
A survey on Image Data Augmentation for Deep Learning
err2019-07-06
err6.3K
errOAAI
errShorten, Connor; Khoshgoftaar, Taghi M.
errShare
errSave
Explainable AI (XAI): Core Ideas, Techniques, and Solutions
err2023-01-16
err178
errOAAI
errDwivedi, Rudresh; Dave, Devam; Naik, Het; Singhal, Smiti; Omer, Rana; Patel, Pankesh; Qian, Bin; Wen, Zhenyu; Shah, Tejal; Morgan, Graham; Ranjan, Rajiv
errShare
errSave
Fine-Grained Image Analysis With Deep Learning: A Survey
err2022-12-01
err0
errOAAI
errXiu-Shen Wei; Yi-Zhe Song; Oisin Mac Aodha; Jianxin Wu; Yuxin Peng; Jinhui Tang; Jian Yang; Serge Belongie
errShare
errSave
researcher View more