.png){kind=icon}
返回
Aligning XAI explanations with software developers' expectations: A case study with code smell prioritization
.png){kind=icon}
PRE
AI
DOI：10.1016/j.eswa.2023.121640.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
EXplainable Artificial Intelligence (XAI) aims at improving users' trust in black-boxed models by explaining their predictions. However, XAI techniques produced unreasonable explanations for software defect prediction since expected outputs (e.g., causes of bugs) were not captured by features used to build models. To set aside feature engineering limitations and evaluate whether XAI could adapt to developers, we exploit XAI for code smell prioritization (i.e., predicting criticalities of sub-optimal coding practices and design choices), whose features could capture developers' major expectations. We assess the gap between XAI explanations and developers' expectations in terms of (1) the accuracy of prediction, (2) the coverage of explanations on expectations, and (3) the complexity of explanations. We also narrow the gap by preserving the features related to developers' expectations as much as possible in feature selection. We find that XAI can explain smells with simpler causes in top 3 to 5 features. Complex smells can be explained in around 10 features, which need more expertise to interpret. Selecting features adapting to the developers' expectations improves coverage by 5% to 29%, with almost no negative impact on accuracy and complexity. Results also highlight the need of dividing coarse-grained prediction targets and developing fine-grained feature engineering.
Keyword:
Code smell
Software quality assurance
Explainable artificial intelligence
Empirical software engineering
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
暂无机构信息
引用论文
Automatic detection of Long Method and God Class code smells through neural source code embeddings
OAAI
OAAI分享收藏分享收藏分享收藏Recombination between an expressed immunoglobulin heavy-chain gene and a germline variable gene segment in a Ly 1+ B-cell lymphoma.png)
Nature
NatureIF0
PREAI
分享收藏
查看更多内容