Local and Global Explainability for Technical Debt Identification

doi:10.1109/TSE.2024.3422427

2024-08-01

PRE

Dimitrios Tsoukalas

Nikolaos Mittas

Elvira-Maria Arvanitou

Apostolos Ampatzoglou *

Alexander Chatzigeorgiou

Dionysios Kehagias

DOI：10.1109/TSE.2024.3422427

原文链接

原文求助

摘要

En 中文

In recent years, we have witnessed an important increase in research focusing on how machine learning (ML) techniques can be used for software quality assessment and improvement. However, the derived methodologies and tools lack transparency, due to the black-box nature of the employed machine learning models, leading to decreased trust in their results. To address this shortcoming, in this paper we extend the state-of-the-art and -practice by building explainable AI models on top of machine learning ones, to interpret the factors (i.e. software metrics) that constitute a module as in risk of having high technical debt (HIGH TD), to obtain thresholds for metric scores that are alerting for poor maintainability, and finally, we dig further to achieve local interpretation that explains the specific problems of each module, pinpointing to specific opportunities for improvement during TD management. To achieve this goal, we have developed project-specific classifiers (characterizing modules as HIGH and NOT-HIGH TD) for 21 open-source projects, and we explain their rationale using the SHapley Additive exPlanation (SHAP) analysis. Based on our analysis, complexity, comments ratio, cohesion, nesting of control flow statements, coupling, refactoring activity, and code churn are the most important reasons for characterizing classes as in HIGH TD risk. The analysis is complemented with global and local means of interpretation, such as metric thresholds and case-by-case reasoning for characterizing a class as in-risk of having HIGH TD. The results of the study are compared against the state-of-the-art and are interpreted from the point of view of both researchers and practitioners.

Keyword:

Codes

Software

Software measurement

Complexity theory

Object oriented modeling

Informatics

Feature extraction

Technical debt

technical debt identification

software quality

software metrics