arrow
Return

Reliable LLM-driven BIM automation through capability-based multi-dimensional evaluation

delete2026-03-25
delete0
PRE
AI
Z
Zaid Alwashah
B
Bo Xiao
H
Hexu Liu *
S
Shane T. Mueller
X
Xiaoyun Shao
DOI:10.1016/j.autcon.2026.106910delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• Six-capability framework to assess LLM reliability in BIM automation. • 31 BIM tasks tested across component, assembly, and system complexity. • Ten error categories; API misuse was the most common failure (48.3%). • MADM scoring shows reliability: 0.603 (comp.), 0.505 (assem.), 0.489 (sys.). • LLMs are strong in debugging but weak in semantic reasoning and API logic.
Keywords:
LLM reliability
BIM automation
capability framework
multi-dimensional evaluation
API misuse

Journal

Automation in Construction cover
Automation in Construction
IF:
11.5
Papers:
6.3K
Citations:
4.2W

Organization

W
western michigan university
Scholars:
530
Papers: 241
Citations: 0
M
Michigan Technological University
Scholars:
5.0K
Papers: 4.4K
Citations: 6.4K
Cited Papers

Cited Papers

Investigating the Use of ChatGPT for the Scheduling of Construction Projects
err2023-03-24
err58
errOAAI
errPrieto, Samuel A.; Mengiste, Eyob T.; de Soto, Borja Garcia
errShare
errSave
errShare
errSave
A benefits realization management building information modeling framework for asset owners
err2014-01-01
err185
PREAI
errLove, Peter E. D.; Matthews, Jane; Simpson, Ian; Hill, Andrew; Olatunji, Oluwole A.
errShare
errSave
A GPT-Powered Assistant for Real-Time Interaction with Building Information Models
err2024-08-13
err2
errOAAI
errFernandes, David; Garg, Sahej; Nikkel, Matthew; Guven, Gursans
errShare
errSave
A text dataset of fire door defects for pre-delivery inspections of apartments during the construction stage
err2025-06-01
err0
PREAI
errWang,Seunghyeon; Moon,Sungkon; Eum,Ikchul; Hwang,Dongjin; Kim,Jaejun
errShare
errSave
researcher View more