arrow
Return

Integrating human knowledge for explainable AI

delete2025-10-15
delete0
delete
OA
AI
E
Eleonora Cappuccio *
B
Bahavathy Kathirgamanathan
S
Salvatore Rinzivillo
G
Gennady Andrienko
N
Natalia Andrienko
DOI:10.1007/s10994-025-06879-xdelete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper presents a methodology for integrating human expert knowledge into machine learning (ML) workflows to improve both model interpretability and the quality of explanations produced by explainable AI (XAI) techniques. We strive to enhance standard ML and XAI pipelines without modifying underlying algorithms, focusing instead on embedding domain knowledge at two stages: (1) during model development through expert-guided data structuring and feature engineering, and (2) during explanation generation via domain-aware synthetic neighbourhoods. Visual analytics is used to support experts in transforming raw data into semantically richer representations. We validate the methodology in two case studies: predicting COVID-19 incidence and classifying vessel movement patterns. The studies demonstrated improved alignment of models with expert reasoning and better quality of synthetic neighbourhoods. We also explore using large language models (LLMs) to assist experts in developing domain-compliant data generators. Our findings highlight both the benefits and limitations of existing XAI methods and point to a research direction for addressing these gaps.
Keywords:
Knowledge-guided explainable AI (XAI)
Visual analytics
Trustworthy AI

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

F
fraunhofer institute iais
Scholars:
6
Papers: 3
Citations: 0
I
ISTI
Scholars:
8
Papers: 3
Citations: 0