arrow
Return

Automatically Assessing Code Understandability

delete2021-03-01
delete48
delete
OA
AI
S
Simone Scalabrino *
G
Gabriele Bavota
C
Christopher Vendome
M
Mario Linares‐Vásquez
D
Denys Poshyvanyk
R
Rocco Oliveto
DOI:10.1109/TSE.2019.2901468delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Understanding software is an inherent requirement for many maintenance and evolution tasks. Without a thorough understanding of the code, developers would not be able to fix bugs or add new features timely. Measuring code understandability might be useful to guide developers in writing better code, and could also help in estimating the effort required to modify code components. Unfortunately, there are no metrics designed to assess the understandability of code snippets. In this work, we perform an extensive evaluation of 121 existing as well as new code-related, documentation-related, and developer-related metrics. We try to (i) correlate each metric with understandability and (ii) build models combining metrics to assess understandability. To do this, we use 444 human evaluations from 63 developers and we obtained a bold negative result: none of the 121 experimented metrics is able to capture code understandability, not even the ones assumed to assess quality attributes apparently related, such as code readability and complexity. While we observed some improvements while combining metrics in models, their effectiveness is still far from making them suitable for practical applications. Finally, we conducted interviews with five professional developers to understand the factors that influence their ability to understand code snippets, aiming at identifying possible new metrics.
Keywords:
Complexity theory
Software
Computer bugs
Readability metrics
Software measurement
Indexes
Software metrics
code understandability
empirical study
negative result

Journal

IEEE Transactions on Software Engineering cover
IEEE Transactions on Software Engineering
IF:
5.6
Papers:
2.9K
Citations:
1.3W

Organization

U
University System of Ohio
Scholars:
15.5W
Papers: 13.0W
Citations: 15.8W
W
William & Mary
Scholars:
77
Papers: 43
Citations: 1.8K
U
universita della svizzera italiana
Scholars:
134
Papers: 64
Citations: 2.1K
U
University of Molise
Scholars:
123
Papers: 60
Citations: 1.3K
M
Miami University
Scholars:
121
Papers: 79
Citations: 1.3K
researcher View more organizations
Cited Papers

Cited Papers

The Daidzein Metabolite, 6,7,4'-Trihydroxyisoflavone, Is a Novel Inhibitor of PKCα in Suppressing Solar UV-Induced Matrix Metalloproteinase 1
err2014-11-19
err0
errOAAI
errTae-Gyu Lim; Jong-Eun Kim; Sung-Young Lee; Jun Park; Myung Yeom; Hanyong Chen; Ann Bode; Zigang Dong; Ki Lee
errShare
errSave
Convective Heat Transfer Enhancement through Laser-Etched Heat Sinks: Elliptic Scale-Roughened and Cones Patterns
err2020-03-15
err0
errOAAI
errLuigi Ventola; Matteo Fasano; Roberta Cappabianca; Luca Bergamasco; Francesca Clerici; Luciano Scaltrito; Eliodoro Chiavazzo; Pietro Asinari
errShare
errSave
Arsenic removal from aqueous solutions by adsorption using novel MIL-53(Fe) as a highly efficient adsorbent
err2015-01-01
err0
PREAI
errTuan. A. Vu; Giang. H. Le; Canh. D. Dao; Lan. Q. Dang; Kien. T. Nguyen; Quang. K. Nguyen; Phuong. T. Dang; Hoa. T. K. Tran; Quang. T. Duong; Tuyen. V. Nguyen; Gun. D. Lee
errShare
errSave
err2000-01-01
err0
PREAI
errMaría J. Martínez; Angeles Freire; Isaura Rodriguez; Belén Bardán; Inés Castro; María T. Inaraja; Ana Ortega; Victor Del Campo; Luis E. Morano; José F. Garcia
errShare
errSave
researcher View more