arrow
Return

Automated robustness testing for LLM-based natural language processing software

delete2025-12-04
delete0
PRE
AI
M
Mingxuan Xiao
X
Xiao Yan
S
Shunhui Ji
H
Hanbo Cai
L
Lei Xue
P
Pengcheng Zhang
DOI:10.1016/j.eswa.2025.130642delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• Propose AORTA, an automated robustness testing framework for LLM-based NLP software. • Develop ABS, an efficient testing method using adaptive beam search and backtracking. • Achieve an average test validity of 86.1. • Reduce test cost by up to 3442s and 219 queries per case over the strongest baseline.

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
2.9W
Citations:
10.2W

Organization

H
Hohai University
Scholars:
2.3W
Papers: 1.8W
Citations: 2.1W
S
Suzhou Vocational Institute of Industrial Technology
Scholars:
12
Papers: 8
Citations: 224