arrow
返回

Negative results for software effort estimation

delete2016-11-21
delete40
PRE
AI
T
Tim Menzies *
Y
Ye Yang
G
George Mathew
B
Barry Boehm
J
Jairus Hihn
DOI:10.1007/s10664-016-9472-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
More than half the literature on software effort estimation (SEE) focuses on comparisons of new estimation methods. Surprisingly, there are no studies comparing state of the art latest methods with decades-old approaches. Accordingly, this paper takes five steps to check if new SEE methods generated better estimates than older methods. Firstly, collect effort estimation methods ranging from classical COCOMO (parametric estimation over a pre-determined set of attributes) to modern (reasoning via analogy using spectral-based clustering plus instance and feature selection, and a recent baseline method proposed in ACM Transactions on Software Engineering). Secondly, catalog the list of objections that lead to the development of post-COCOMO estimation methods. Thirdly, characterize each of those objections as a comparison between newer and older estimation methods. Fourthly, using four COCOMO-style data sets (from 1991, 2000, 2005, 2010) and run those comparisons experiments. Fifthly, compare the performance of the different estimators using a Scott-Knott procedure using (i) the A12 effect size to rule out small differences and (ii) a 99 % confident bootstrap procedure to check for statistically different groupings of treatments. The major negative result of this paper is that for the COCOMO data sets, nothing we studied did any better than Boehms original procedure. Hence, we conclude that when COCOMO-style attributes are available, we strongly recommend (i) using that data and (ii) use COCOMO to generate predictions. We say this since the experiments of this paper show that, at least for effort estimation, how data is collected is more important than what learner is applied to that data.
Keyword:
Effort estimation
COCOMO
CART
Nearest neighbor
Clustering
Feature selection
Prototype generation
Bootstrap sampling
Effect size
A12
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Empirical Software Engineering 封面图
Empirical Software Engineering
IF:
3.6
论文数:
2.0K
被引数:
5.3K

机构

U
university of southern california
学者数:
4.7W
论文数: 3.8W
被引数: 51
N
national aeronautics & space administration (nasa)
学者数:
3.1W
论文数: 2.6W
被引数: 46
S
Stevens Institute of Technology
学者数:
2.9K
论文数: 2.9K
被引数: 3.2K
N
North Carolina State University
学者数:
2.6W
论文数: 2.3W
被引数: 3.7W
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
Body-Machine Interfaces after Spinal Cord Injury: Rehabilitation and Brain Plasticity
err2016-12-19
err0
errOAAI
errIsmael Seáñez-González; Camilla Pierella; Ali Farshchiansadegh; Elias Thorp; Xue Wang; Todd Parrish; Ferdinando Mussa-Ivaldi
err分享
err收藏
Exploiting the Essential Assumptions of Analogy-Based Effort Estimation
err2012-03-01
err122
PREAI
errKocaguneli, Ekrem; Menzies, Tim; Bener, Ayse Basar; Keung, Jacky W.
err分享
err收藏
err
IF0
err
err0
PREAI
err
err分享
err收藏
Clinical performance and exercise hemodynamics in patients with severe secondary tricuspid regurgitation and chronic atrial fibrillation
err2021-06-04
err0
errOAAI
errJesper K. Jensen; Tor S. Clemmensen; Christian A. Frederiksen; Joachim Schofer; Mads J. Andersen; Steen H. Poulsen
err分享
err收藏
How water exchange and seasonality affect the eutrophication of Murchison Bay, Lake Victoria
err2015-07-01
err0
errOAAI
errSuzan Luyiga; Sigrid Haande; Ronald P. Semyalo; Yusuf S. Kizito; Anne Miyingo-Kezimbira; Pål Brettum; Anne Lyche Solheim; Robinson Odong; Santa Maria Asio; Knut Helge Jensen; Petter Larsson
err分享
err收藏
学者 查看更多内容