arrow
Return

Toward explaining value concerns in software artifacts: A human-in-the-loop method

delete2026-07-01
delete0
PRE
AI
D
Davoud Mougouei *
S
Son Van Pham
A
Azarnik, Ahmad
M
Mahdi Fahmideh
A
Arif Nurwidyantoro
M
Mougouei, Elahe
A
Amanul Haque
H
Hoa Khanh Dam
S
Saima Rafi
J
Javed Ali Khan
DOI:10.1016/j.infsof.2026.108254delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Context: Violations of human values in software can lead to user dissatisfaction, economic harm, and loss of trust. Existing software engineering research has focused on detecting such violations through manual labeling or automated classification, without explaining the mechanisms through which they occur. This lack of explanation makes reported violations difficult to verify and offers limited guidance for addressing them. Objectives: This study introduces a human-in-the-loop method that explains potential violations of human values in software artifacts-value concerns-by articulating the conditions under which they may arise. Methods: The proposed human-in-the-loop method integrates the automated reasoning capabilities of a large language model (ChatGPT) with human assessment to identify and articulate value concerns in software artifacts. We evaluate the method through a case study of 1200 Android and iOS APIs, assessing its ability to produce traceable accounts of potential value violations. Results: The results show that ChatGPT's inferences about value concerns are reasonably accurate but incomplete. Errors arise from unfounded explanations and overextended reasoning, while the persuasive presentation of LLM outputs can make these errors difficult to recognize. The human-in-the-loop method mitigates these issues through human review. Conclusion: Our findings support the use of LLMs as reasoning partners that, when combined with human oversight, can effectively explain value concerns in software artifacts.
Keywords:
Explaining
Value concerns
Software artifacts
LLMs

Journal

Information and Software Technology cover
Information and Software Technology
IF:
4.3
Papers:
3.8K
Citations:
7.7K

Organization

E
Edinburgh Napier University
Scholars:
50
Papers: 37
Citations: 0
G
gadjah mada university
Scholars:
224
Papers: 81
Citations: 0
U
university of hertfordshire
Scholars:
81
Papers: 56
Citations: 0
U
university of southern queensland
Scholars:
205
Papers: 99
Citations: 0
D
Deakin University
Scholars:
533
Papers: 244
Citations: 0
I
Islamic Azad University
Scholars:
756
Papers: 380
Citations: 0
U
Universiti Teknologi Malaysia
Scholars:
215
Papers: 88
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

No cited papers available