.png){kind=icon}
返回
An eXplainable Artificial Intelligence Methodology on Big Data Architecture
.png){kind=icon}
OA
AI
DOI：10.1007/s12559-024-10272-6.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Although artificial intelligence has become part of everyone's real life, a trust crisis against such systems is occurring, thus increasing the need to explain black-box predictions, especially in the military, medical, and financial domains. Modern eXplainable Artificial Intelligence (XAI) techniques focus on benchmark datasets, but the cognitive applicability of such solutions under big data settings is still unclear due to memory or computation constraints. In this paper, we extend a model-agnostic XAI methodology, named Cluster-Aided Space Transformation for Local Explanation (CASTLE), to be able to deal with high-volume datasets. CASTLE aims to explain the black-box behavior of predictive models by combining both local (i.e., based on the input sample) and global (i.e., based on the whole scope for action of the model) information. In particular, the local explanation provides a rule-based explanation for the prediction of a target instance as well as the directions to update the likelihood of the predicted class. Our extension leverages modern big data technologies (e.g., Apache Spark) to handle the high volume, variety, and velocity of huge datasets. We have evaluated the framework on five datasets, in terms of temporal efficiency, explanation quality, and model significance. Our results indicate that the proposed approach retains the high-quality explanations associated with CASTLE while efficiently handling large datasets. Importantly, it exhibits a sub-linear, rather than exponential, dependence on dataset size, making it a scalable solution for massive datasets or in any big data scenario.
Keyword:
eXplainable artificial intelligence
Clustering
Artificial intelligence
Big data
期刊
IF:
4.3
论文数:
1.6K
被引数:
3.6K
机构
引用论文
The convergence and interplay of edge, fog, and cloud in the AI-driven Internet of Things (IoT)AI驱动的物联网 (IoT) 中边缘、雾和云的融合和相互作用
PREAI
分享收藏Computational approaches to Explainable Artificial Intelligence: Advances in theory, applications and trends可解释人工智能的计算方法: 理论，应用和趋势的进展.png)
INFORMATION FUSION
OAAI
INFORMATION FUSIONIF15.5
OAAI分享收藏Explainable artificial intelligence for breast cancer: A visual case-based reasoning approach乳腺癌的可解释人工智能: 基于视觉案例的推理方法OAAI
OAAI分享收藏Explainable Artificial Intelligence in Alzheimer's Disease Classification: A Systematic Review阿尔茨海默病分类中的可解释人工智能: 系统综述OAAI
OAAI分享收藏
查看更多内容