arrow
返回

Tuning for software analytics: Is it really necessary?

delete2016-08-01
delete160
delete
OA
AI
W
Wei Fu *
T
Tim Menzies
X
Xipeng Shen
DOI:10.1016/j.infsof.2016.04.017delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Context Data miners have been widely used in software engineering to, say, generate defect predictors from static code measures. Such static code defect predictors perform well compared to manual methods, and they are easy to use and useful to use. But one of the black arts of data mining is setting the tunings that control the miner. Objective: We seek simple, automatic, and very effective method for finding those tunings. Method: For each experiment with different data sets (from open source JAVA systems), we ran differential evolution as an optimizer to explore the tuning space (as a first step) then tested the tunings using hold-out data. Results: Contrary to our prior expectations, we found these tunings were remarkably simple: it only required tens, not thousands, of attempts to obtain very good results. For example, when learning software defect predictors, this method can quickly find tunings that alter detection precision from 0% to 60%. Conclusion: Since (1) the improvements are so large, and (2) the tuning is so simple, we need to change standard methods in software analytics. At least for defect prediction, it is no longer enough to just run a data miner and present the result without conducting a tuning optimization study. The implication for other kinds of analytics is now an open and pressing issue. (c) 2016 Elsevier B.V. All rights reserved.
Keyword:
Defect prediction
CART
Random forest
Differential evolution
Search-based software engineering
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Information and Software Technology 封面图
Information and Software Technology
IF:
4.3
论文数:
3.8K
被引数:
7.7K

机构

N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
引用论文

引用论文

err分享
err收藏
err分享
err收藏
AbYSS: Adapting scatter search to multiobjective optimization深渊: 将分散搜索应用于多目标优化
err2008-08-01
err222
PREAI
errNebro, Antonio J.; Luna, Francisco; Alba, Enrique; Dorronsoro, Bernabe; Durillo, Juan J.; Beham, Andreas
err分享
err收藏
Local versus Global Lessons for Defect Prediction and Effort Estimation
err2013-06-01
err169
PREAI
errMenzies, Tim; Butcher, Andrew; Cok, David; Marcus, Andrian; Layman, Lucas; Shull, Forrest; Turhan, Burak; Zimmermann, Thomas
err分享
err收藏
err1997-01-01
err0
PREAI
errRainer Storn; Kenneth Price
err分享
err收藏
学者 查看更多内容