arrow
Return

A Model Context Protocol-Based Retrieval-Augmented Generation Framework for Resource-Constrained Environments

delete2026-06-09
delete0
delete
OA
AI
N
Ning Zhang
H
Haoyu Mao
S
Song Zhang
X
Xuanchen Liu
H
Haiou Jiang *
DOI:10.1007/s11063-026-11857-ydelete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Deploying Large Language Models on edge platforms with mobile-oriented resource constraints faces challenges of limited resources and hallucination issues. While Retrieval-Augmented Generation (RAG) mitigates hallucinations through external knowledge, existing RAG systems on such platforms suffer from poor retrieval quality and lack standardized protocols. We propose a RAG framework for edge platforms with mobile-oriented resource constraints based on the Model Context Protocol (MCP), enabling plug-and-play access to heterogeneous knowledge bases. Our framework introduces a weighted voting fusion ranking mechanism integrating BERT-Recall, F1, Relaxed Exact Match (REM), and Query Relevance scores to enhance retrieval accuracy, combined with model quantization and few-shot learning for efficient on-device operation. Experiments on SQuAD, HotpotQA, and TriviaQA demonstrate that our framework achieves higher accuracy and lower error rates than state-of-the-art methods while maintaining low latency.
Keywords:
Retrieval-augmented generation
Model context protocol
Large language model
Knowledge retrieval
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Processing Letters cover
Neural Processing Letters
IF:
2.8
Papers:
169
Citations:
5.5K

Organization

No organization information available