arrow
Return

Revolutionizing Scientific Figure Decoding: Benchmarking LLM Data Extraction Performance

delete2026-03-01
delete0
PRE
AI
T
Turan, Ivan *
T
Taylor D. Sparks *
DOI:10.1007/s40192-026-00443-8delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Large language models have demonstrated impressive capabilities in natural language understanding and processing. However, as AI and LLMs continue to evolve, their ability to accurately and efficiently interpret data from scientific figures and plots remains obscure. In this study, we test and evaluate the ability of state-of-the-art large language models (LLMs) in analyzing and extracting information from scientific figures commonly found in materials science literature, including stress-strain curves, heatmaps, 3D plots, contour plots, and other visual representations. We utilize a benchmark dataset comprising figures derived from several published works to evaluate the model's performance in quantitative material property extraction. Preliminary results highlight both the potential and current limitations of LLMs in handling visual scientific content, pointing toward future opportunities for AI-assisted data extraction in materials informatics.
Keywords:
Large language models
Curve analysis
Materials property extraction
Multi-modal learning

Journal

I
Integrating Materials and Manufacturing Innovation
IF:
2.5
Papers:
50
Citations:
1.3K

Organization

U
University of Utah
Scholars:
2.9W
Papers: 2.2W
Citations: 4.6W
U
Utah System of Higher Education
Scholars:
4.6W
Papers: 4.0W
Citations: 161