arrow
Return

Agent-Based Framework for Engineering Document Comprehension With Large Language Models

delete2026-07-01
delete0
PRE
AI
X
Xie, Haoyang
J
Ju, Feng *
DOI:10.1115/1.4071111delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Engineering documents, such as design rule books and technical requirements, play a critical role in helping engineers ensure that their designs meet specified standards. Quickly retrieving and reasoning over such documents is essential for efficient engineering workflows. Recent advances in large language models (LLMs) and generative AI make it possible to automatically interpret and reason over complex engineering documents. However, engineering covers many distinct and highly specialized subdomains. Because general-purpose LLMs such as GPT or Gemini are not trained or fine-tuned on these domains, their performance on domain-specific reasoning remains limited. It is impractical to curate dedicated datasets for every engineering subdomain, which would be required for both fine-tuning and building reliable retrieval-augmented generation frameworks. Therefore, it is crucial to develop a principled agent-based design paradigm that can be instantiated for specific engineering documentation tasks under data-scarce conditions. To address this, we propose an agent-based framework that leverages existing LLM capabilities through specialized agents coordinated by a routing mechanism, achieving a scalable and fully automated workflow. We evaluate our framework on DesignQA as a representative case study and show that it consistently outperforms baseline methods. Moreover, the results highlight its potential to generalize across diverse engineering requirements. In future work, we plan to extend this framework to additional engineering domains and explore more advanced agent strategies.
Keywords:
agent-based framework
large language models (LLMs)
technical requirements
engineering document understanding
artificial intelligence
engineering informatics
knowledge engineering
machine learning for engineering applications

Journal

Journal of Computing and Information Science in Engineering cover
Journal of Computing and Information Science in Engineering
IF:
3.3
Papers:
111
Citations:
2.2K

Organization

A
arizona state university
Scholars:
3.5K
Papers: 1.9K
Citations: 0