arrow
Return

Accurate Information Type Classification for Software Issue Discussions With Random Oversampling

delete2024-01-01
delete1
delete
OA
AI
B
Boburmirzo Muhibullaev
J
Jindae Kim *
DOI:10.1109/ACCESS.2024.3398732delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
An Issue Tracking System (ITS) plays a crucial role in software development and provides valuable information for understanding issue management. In an ITS, software developers often discuss issues that are reported during software development. Recent studies analyzed such issue discussions and identified information types of issue comments that appeared in the discussions. Automatic classification of the information types can help developers understand and locate required information more easily, but existing techniques cannot provide accurate classification. In this study, we propose a more accurate technique to classify information types of issue comments. The key to increasing classification performance is employing random oversampling to deal with imbalances among training instances of different information types. With random oversampling, we trained a classifier using logistic regression with hyperparameter tuning and achieved an average 0.95 F1-score, which was much higher than 0.53 of the compared existing technique. We also considered two other key aspects of the technique to fully investigate the potential performance improvement. We expanded an existing issue comment dataset by adding 4,098 more instances, almost double the size of the dataset. We analyzed the influence of hyperparameters on classification performance and found that using values within an appropriate range is important to achieve high performance.
Keywords:
Training
Software
Logistic regression
Tuning
Target tracking
Computer bugs
Classification algorithms
Information integrity
Software development management
Information filters
Sampling methods
Performance evaluation
Hyperparameter optimization
Issue discussion analysis
issue management
issue tracking systems
open source software
random oversampling

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

No organization information available