arrow
Return

Agent-Based Framework for Engineering Document Comprehension With Large Language Models

delete2026-07-01
delete0
PRE
AI
H
Haoyang Xie
J
Ju, Feng *
DOI:10.1115/1.4071111delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Engineering documents, such as design rule books and technical requirements, play a critical role in helping engineers ensure that their designs meet specified standards. Quickly retrieving and reasoning over such documents is essential for efficient engineering workflows. Recent advances in large language models (LLMs) and generative AI make it possible to automatically interpret and reason over complex engineering documents. However, engineering covers many distinct and highly specialized subdomains. Because general-purpose LLMs such as GPT or Gemini are not trained or fine-tuned on these domains, their performance on domain-specific reasoning remains limited. It is impractical to curate dedicated datasets for every engineering subdomain, which would be required for both fine-tuning and building reliable retrieval-augmented generation frameworks. Therefore, it is crucial to develop a principled agent-based design paradigm that can be instantiated for specific engineering documentation tasks under data-scarce conditions. To address this, we propose an agent-based framework that leverages existing LLM capabilities through specialized agents coordinated by a routing mechanism, achieving a scalable and fully automated workflow. We evaluate our framework on DesignQA as a representative case study and show that it consistently outperforms baseline methods. Moreover, the results highlight its potential to generalize across diverse engineering requirements. In future work, we plan to extend this framework to additional engineering domains and explore more advanced agent strategies.
Keywords:
agent-based framework
large language models (LLMs)
technical requirements
engineering document understanding
artificial intelligence
engineering informatics
knowledge engineering
machine learning for engineering applications

Journal

Journal of Computing and Information Science in Engineering cover
Journal of Computing and Information Science in Engineering
IF:
3.3
Papers:
113
Citations:
2.2K

Organization

A
arizona state university
Scholars:
3.8K
Papers: 2.0K
Citations: 0
Cited Papers

Cited Papers

BLEU
err2001-01-01
err0
errOAAI
errKishore Papineni; Salim Roukos; Todd Ward; Wei-Jing Zhu
errShare
errSave
A Survey on In-context Learning
err2024-01-01
err0
PREAI
errQingxiu Dong; Lei Li; Damai Dai; Ce Zheng; Jingyuan Ma; Rui Li; Heming Xia; Jingjing Xu; Zhiyong Wu; Baobao Chang; Xu Sun; Lei Li; Zhifang Sui
errShare
errSave
errShare
errSave
errShare
errSave
DesignQA: A Multimodal Benchmark for Evaluating Large Language Models' Understanding of Engineering Documentation
err2024-12-23
err0
errOAAI
errDoris, Anna C.; Grandi, Daniele; Tomich, Ryan; Alam, Md Ferdous; Ataei, Mohammadmehdi; Cheong, Hyunmin; Ahmed, Faez
errShare
errSave
Elicitron: A Large Language Model Agent-Based Simulation Framework for Design Requirements Elicitation
err2025-01-16
err1
errOAAI
errAtaei, Mohammadmehdi; Cheong, Hyunmin; Grandi, Daniele; Wang, Ye; Morris, Nigel; Tessier, Alexander
errShare
errSave
Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey
err2026-02-28
err0
PREAI
errLing,Chen; Zhao,Xujiang; Lu,Jiaying; Deng,Chengyuan; Zheng,Can; Wang,Junxiang; Chowdhury,Tanmoy; Li,Yun; Cui,Hejie; Zhang,Xuchao; Zhao,Tianjiao; Panalkar,Amit; Mehta,Dhagash; Pasquali,Stefano; Cheng,Wei; Wang,Haoyu; Liu,Yanchi; Chen,Zhengzhang; Chen,Haifeng; White,Chris; Gu,Quanquan; Pei,Jian; Yang,Carl; Zhao,Liang
errShare
errSave
A Conceptual Design Method Based on Concept-Knowledge Theory and Large Language Models
err2024-11-12
err1
PREAI
errChen, Liuqing; Xia, Duowei; Jiang, Zhaojun; Tan, Xinyang; Sun, Lingyun; Zhang, Lin
errShare
errSave
researcher View more