arrow
Return

Addressing Technical Challenges in Large Language Model-Driven Educational Software System

delete2025-01-01
delete0
delete
OA
AI
N
Nacha Chondamrongkul
G
Georgi Hristov
P
Punnarumol Temdee *
DOI:10.1109/ACCESS.2025.3531380delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The integration of large language models (LLMs) into educational systems poses significant challenges across several key attributes, including integration, explainability, testability, and scalability. These challenges arise from the complexity of coordinating system components, difficulty interpreting LLM decision-making processes, and the need for reliable, consistent model outputs in varied educational scenarios. Additionally, ensuring scalability requires robust autoscaling mechanisms and suitable architecture design to handle fluctuating workloads. This paper tackles these challenges by proposing tactics to improve system integration, enhance explainability through metadata and an algorithm process, ensure response consistency via regression testing, and facilitate efficient autoscaling through an event-driven microservice architecture. The evaluation results highlight the effectiveness of these tactics, confirming both functional consistency and robust system performance under varying loads.
Keywords:
Vectors
Education
Cognition
Reliability
Decision making
Scalability
Accuracy
Testing
Software systems
Retrieval augmented generation
Artificial intelligence
educational application
generative AI
large language model
LLM

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

U
University of Ruse
Scholars:
216
Papers: 167
Citations: 155
M
Mae Fah Luang University
Scholars:
1.8K
Papers: 1.4K
Citations: 2.7K