arrow
Return

Simpler Hyperparameter Optimization for Software Analytics: Why, How, When?

delete2022-08-01
delete14
delete
OA
AI
A
Amritanshu Agrawal
X
Xueqi Yang
R
Rishabh Agrawal
R
Rahul Yedida
X
Xipeng Shen
T
Tim Menzies *
DOI:10.1109/TSE.2021.3073242delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
How can we make software analytics simpler and faster? One method is to match the complexity of analysis to the intrinsic complexity of the data being explored. For example, hyperparameter optimizers find the control settings for data miners that improve the predictions generated via software analytics. Sometimes, very fast hyperparameter optimization can be achieved by DODGE-ing; i.e., simply steering way from settings that lead to similar conclusions. But when is it wise to use that simple approach and when must we use more complex (and much slower) optimizers? To answer this, we applied hyperparameter optimization to 120 SE data sets that explored bad smell detection, predicting Github issue close time, bug report analysis, defect prediction, and dozens of other non-SE problems. We find that the simple DODGE works best for data sets with low intrinsic dimensionality (mu(D) approximate to 3) and very poorly for higher-dimensional data (mu(D) > 8). Nearly all the SE data seen here was intrinsically low-dimensional, indicating that DODGE is applicable for many SE analytics tasks.
Keywords:
Software analytics
hyperparameter optimization
defect prediction
bad smell detection
issue close time
bug reports
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Software Engineering cover
IEEE Transactions on Software Engineering
IF:
5.6
Papers:
2.9K
Citations:
1.1W

Organization

N
North Carolina State University
Scholars:
2.6W
Papers: 2.3W
Citations: 3.7W
Cited Papers

Cited Papers

Tumor-induced endothelial cell apoptosis: Roles of NAD(P)H oxidase-derived reactive oxygen species
err2011-04-19
err0
PREAI
errRuei-Zeng Lin; Tsung-Pao Wang; Ruei-Jiun Hung; Yung-Jen Chuang; Chi-Chen Michae Chien; Hwan-You Chang
errShare
errSave
Geopolitics and discourse
err1992-03-01
err0
PREAI
errGearóid Ó Tuathail; John Agnew
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
“Cystamatic” Review: Is Surgery Mandatory for Pneumatosis Cystoides Intestinalis?
err2019-08-13
err0
PREAI
errM. Brighi; S. Vaccari; A. Lauro; V. D’Andrea; N. Pagano; I. R. Marino; M. Cervellera; V. Tonini
errShare
errSave
Exploiting the Essential Assumptions of Analogy-Based Effort Estimation
err2012-03-01
err122
PREAI
errKocaguneli, Ekrem; Menzies, Tim; Bener, Ayse Basar; Keung, Jacky W.
errShare
errSave
researcher View more