arrow
Return

Towards explainable language reasoning via multi-modal knowledge graphs

delete2026-05-06
delete0
delete
OA
AI
C
Chunyu Lu
J
Jun Luo
K
Kang Yu
T
Tianran Chen
X
Xueli Wang *
F
Feng Qian
C
Chen Xi
DOI:10.1038/s41598-026-51127-4delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
The increasing complexity of natural language reasoning in artificial intelligence necessitates a shift from opaque, black-box processing to transparent, interpretable decision-making. While large language models (LLMs) demonstrate remarkable generative capabilities, their reasoning pathways often remain implicit, which limits auditability in high-stakes settings. To address this issue, we propose a framework for explainable language reasoning grounded in Multi-Modal Knowledge Graphs (MMKGs). Our approach unifies textual, visual, and structural knowledge in a shared graph representation, enabling the system to anchor inference in explicit semantic relations rather than in latent correlations alone. We introduce a planner-executor design in which an LLM generates constrained symbolic plans and a deterministic graph engine executes them to return both an answer and a replayable explanation subgraph. Empirically, the framework is competitive on six textual and multimodal benchmarks, reaching 79.8% Hits@1 on WebQSP and 49.3 accuracy on OK-VQA under the protocol used in this study. We deliberately report the main quantitative comparisons as point estimates and interpret small margins conservatively. The principal contribution of the work is therefore the MMKG-grounded reasoning architecture, its operationally auditable explanation mechanism, and the accompanying clarification of what can and cannot be claimed theoretically about explanation faithfulness.
Keywords:
explainable language reasoning
multi-modal knowledge graphs
symbolic planning
deterministic graph execution
operational auditability
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
27.4W
Citations:
83.5W

Organization

C
china national petroleum corporation
Scholars:
1.9K
Papers: 716
Citations: 0