1
Return

Disentangling Faithfulness Hallucinations in Retrieval-Augmented Generation: A Systematic Benchmark and Analysis

delete2026-07-22
delete0
delete
OA
AI
C
Chandana Sree Mala *
G
Gizem Gezici
F
Fosca Giannotti
DOI:10.1007/s10994-026-07121-ydelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Faithfulness hallucinations, where large language models generate outputs unsupported by retrieved evidence, remain a central challenge for trustworthy AI. We present a systematic empirical evaluation of faithfulness in retrieval-augmented generation (RAG) systems using two benchmark datasets, HotpotQA and HaluBench, covering both multi-hop reasoning and single-hop hallucination detection. We analyze three small-to-mid-sized (2B-8B) open-weight LLMs in combination with multiple retrieval strategies, including sparse, dense, and hybrid approaches, as well as score-based and rank-based fusion techniques, enabling a comprehensive assessment of retrieval-generation interactions. By disentangling retrieval and generation errors, we characterize how different pipeline components contribute to hallucinations in RAG systems. Our analysis provides actionable insights and practical evaluation protocols, highlighting the critical role of robust retrieval and careful system design. These findings offer a benchmarking-oriented perspective for developing more reliable and faithful RAG systems within evaluated model scales.
Keywords:
Retrieval augmented generation
Large language models
Faithfulness hallucinations
Hallucination mitigation
Hybrid retrieval
Knowledge grounding
Multi-hop reasoning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Machine Learning cover
Machine Learning
IF:
2.9
Papers:
2.6K
Citations:
3.4W

Organization

Scuola Normale Superiore cover
Scuola Normale Superiore
Scholars:
162
Papers: 115
Citations: 3.5K
U
university of pisa
Scholars:
3.6K
Papers: 1.4K
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers