.png){kind=icon}
Return
Semantic architectures for domain-specific programming AI agents: lessons from a JavaScript semantic assistant
.png){kind=icon}
OA
AI
DOI：10.1038/s41598-026-55094-8.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
This work proposes a semantic ontology-based dataset leveraging fine tuning large language model to facilitate JavaScript debugging and domain-specific code generation. Ontology is used to train the model with a dataset that has an exact or logical relationship between JavaScript syntax elements. The system gains deep subject knowledge with the help of a formal linked database, producing a high-quality QandA dataset from it, and employing parameter-efficient fine-tuning of a base LLM (LLaMA-3B). The fine-tuned model is assessed through a strict framework for domain competency. Code correctness, logical consistency, adaptability, and error detection efficiency metrics were used for evaluation. Experimental results show that the ontology-augmented model performs much better across all measures than baseline generic LLaMA model. Baseline here refers to a model refined on non-ontology data, and retrieval-based techniques. Logical verification and comparisons of fine-tuning techniques (BitFit, LoRA, and standard tuning) is provided. For performance contextualization, an additional benchmark against a cutting-edge code model (CodeLlama) is provided. The enhanced outcomes show that using ontologies to incorporate structured semantic knowledge can result in significant improvements in domain-specific code comprehension, providing a repeatable route for creating specialized programming AI systems. For reproducibility, the implementation and resources (ontology, SPARQL queries, code) are made publicly accessible.
Keywords:
JavaScript
ontology
fine-tuning
code generation
programming AI
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
3.9
Papers:
28.2W
Citations:
83.5W
Organization
View more organizations
Cited Papers
No cited papers available