1
Return

LaQual: An automated framework for LLM app quality evaluation

delete2026-06-08
delete0
PRE
AI
Y
Yan Wang
X
Xinyi Hou
J
Junjun Si *
Y
Yanjie Zhao
W
Weiguo Lin
H
Haoyu Wang
DOI:10.1016/j.jss.2026.112997delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
• We propose LaQual, an automated framework for fine-grained LLM app evaluation. • A time-decay weighting mechanism is introduced to mitigate temporal ranking bias. • LLMs adaptively generate scenario-specific metrics and tasks for evaluation. • Automated scores achieve high consistency with expert judgment across categories. • User studies confirm significant gains in decision efficiency and confidence.

Journal

Journal of Systems and Software cover
Journal of Systems and Software
IF:
4.1
Papers:
5.4K
Citations:
8.4K

Organization

C
communication university of china
Scholars:
404
Papers: 211
Citations: 0
H
huazhong university of science and technology
Scholars:
2.3W
Papers: 7.2K
Citations: 5
Cited Papers

Cited Papers

Citing Papers

Citing Papers