arrow
返回

PHANTOM: Curating GitHub for engineered software projects using time-series clustering

delete2020-05-27
delete18
delete
OA
AI
P
Pickerill, Peter
J
Jungen, Heiko Joshua
M
Mirosław Ochodek *
M
Mackowiak, Michal
M
Miroslaw Staron
DOI:10.1007/s10664-020-09825-8delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Context Within the field of Mining Software Repositories, there are numerous methods employed to filter datasets in order to avoid analysing low-quality projects. Unfortunately, the existing filtering methods have not kept up with the growth of existing data sources, such as GitHub, and researchers often rely on quick and dirty techniques to curate datasets. Objective The objective of this study is to develop a method capable of filtering large quantities of software projects in a resource-efficient way. Method This study follows the Design Science Research (DSR) methodology. The proposed method, PHANTOM, extracts five measures from Git logs. Each measure is transformed into a time-series, which is represented as a feature vector for clustering using the k-means algorithm. Results Using the ground truth from a previous study, PHANTOM was shown to be able to rediscover the ground truth on the training dataset, and was able to identify engineered projects with up to 0.87 Precision and 0.94 Recall on the validation dataset. PHANTOM downloaded and processed the metadata of 1,786,601 GitHub repositories in 21.5 days using a single personal computer, which is over 33% faster than the previous study which used a computer cluster of 200 nodes. The possibility of applying the method outside of the open-source community was investigated by curating 100 repositories owned by two companies. Conclusions It is possible to use an unsupervised approach to identify engineered projects. PHANTOM was shown to be competitive compared to the existing supervised approaches while reducing the hardware requirements by two orders of magnitude.
Keyword:
Mining software repositories
GitHub
Data curation
Curation tools
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Empirical Software Engineering 封面图
Empirical Software Engineering
IF:
3.6
论文数:
2.0K
被引数:
5.3K

机构

P
Poznan University of Technology
学者数:
4.4K
论文数: 4.1K
被引数: 3
C
chalmers university of technology
学者数:
1.5W
论文数: 1.6W
被引数: 10
U
university of gothenburg
学者数:
2.6W
论文数: 2.3W
被引数: 33
学者 查看更多机构
引用论文

引用论文

err分享
err收藏
An in-depth study of the promises and perils of mining GitHub深入研究采矿GitHub的承诺和危险
err2015-09-05
err175
PREAI
errKalliamvakou, Eirini; Gousios, Georgios; Blincoe, Kelly; Singer, Leif; German, Daniel M.; Damian, Daniela
err分享
err收藏
err分享
err收藏
Reservoir Facies Modelling: New Advances in MPS储层相建模:MPS的新进展
err2005-01-01
err0
PREAI
errAndrew Harding; Sebastien Strebelle; Marjorie Levy; Julian Thorne; Deyi Xie; Sebastien Leigh; Rachel Preece; Robert Scamman
err分享
err收藏
A Dynamic Protein Interaction Landscape of the Human Centrosome-Cilium Interface
errCell
IF0
err2015-12-01
err0
errOAAI
errGagan D. Gupta; Étienne Coyaud; João Gonçalves; Bahareh A. Mojarad; Yi Liu; Qianzhu Wu; Ladan Gheiratmand; David Comartin; Johnny M. Tkach; Sally W.T. Cheung; Mikhail Bashkurov; Monica Hasegan; James D. Knight; Zhen-Yuan Lin; Markus Schueler; Friedhelm Hildebrandt; Jason Moffat; Anne-Claude Gingras; Brian Raught; Laurence Pelletier
err分享
err收藏
Thermodynamic and Artificial Intelligence Approaches of H2S Solubility in Some Imidazolium-Based Ionic Liquids
err2023-01-30
err0
PREAI
errMorteza Esfandyari; Mahdi Koolivand Salooki; Mohammad Shokouhi; Jafar Sadeghzadeh Ahari; Niloufar Fatourehchi
err分享
err收藏
Feeding critically ill patients: What is the optimal amount of energy?
err2007-09-01
err111
PREAI
errStapleton, Renee D.; Jones, Naomi; Heyland, Daren K.
err分享
err收藏
err分享
err收藏
学者 查看更多内容