Return
A Model Context Protocol-Based Retrieval-Augmented Generation Framework for Resource-Constrained Environments
DOI:10.1007/s11063-026-11857-y.png)
Abstract
En 中文
Deploying Large Language Models on edge platforms with mobile-oriented resource constraints faces challenges of limited resources and hallucination issues. While Retrieval-Augmented Generation (RAG) mitigates hallucinations through external knowledge, existing RAG systems on such platforms suffer from poor retrieval quality and lack standardized protocols. We propose a RAG framework for edge platforms with mobile-oriented resource constraints based on the Model Context Protocol (MCP), enabling plug-and-play access to heterogeneous knowledge bases. Our framework introduces a weighted voting fusion ranking mechanism integrating BERT-Recall, F1, Relaxed Exact Match (REM), and Query Relevance scores to enhance retrieval accuracy, combined with model quantization and few-shot learning for efficient on-device operation. Experiments on SQuAD, HotpotQA, and TriviaQA demonstrate that our framework achieves higher accuracy and lower error rates than state-of-the-art methods while maintaining low latency.
Keywords:
Retrieval-augmented generation
Model context protocol
Large language model
Knowledge retrieval
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
2.8
Papers:
169
Citations:
5.5K
Organization
No organization information available

