arrow
返回

A bot identification model and tool based on GitHub activity sequences☆

delete2025-03-01
delete0
PRE
AI
N
Natarajan Chidambaram *
A
Alexandre Decan
T
Tom Mens
DOI:10.1016/j.jss.2024.112287delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Identifying whether GitHub contributors are automated bots is important for empirical research on collaborative software development practices. Multiple such bot identification approaches have been proposed in the past. In this article, we identify the limitations of these approaches and we propose a new binary classification model, called BIMBAS, to overcome these limitations. To do so, we propose anew ground-truth dataset containing 1035 bots and 1115 humans on GitHub. We train BIMBAS on a wide range of features extracted from the activity sequences of these GitHub contributors. We show that the performance of BIMBAS (in terms of precision, recall, F1 score and AUC) is comparable to state-of-the-art bot identification approaches, while being able to identify bots engaged in a wider range of activity types. We implement RABBIT, an open-source command-line bot identification tool based on BIMBAS. We demonstrate its ability to be used at scale, and show that its efficiency outperforms the state-of-the-art.
Keyword:
Bot identification
Classification model
GitHub
Collaborative software development

期刊

Journal of Systems and Software 封面图
Journal of Systems and Software
IF:
4.1
论文数:
5.4K
被引数:
8.4K

机构

U
university of mons
学者数:
3.1K
论文数: 3.6K
被引数: 3
引用论文

引用论文

Support Vector Machines for classification and regression
errANALYST
IF3.3
err2010-01-01
err841
PREAI
errBrereton, Richard G.; Lloyd, Gavin R.
err分享
err收藏
err分享
err收藏
err分享
err收藏
Recognizing Bot Activity in Collaborative Software Development
err2022-09-01
err5
errOAAI
errGolzadeh, Mehdi; Mens, Tom; Decan, Alexandre; Constantinou, Eleni; Chidambara, Natarajan
err分享
err收藏
Pull request latency explained: an empirical overview拉取请求延迟解释: 实证概述
err2022-07-04
err12
errOAAI
errZhang, Xunhui; Yu, Yue; Wang, Tao; Rastogi, Ayushi; Wang, Huaimin
err分享
err收藏
World of code: enabling a research workflow for mining and analyzing the universe of open source VCS data
err2021-02-25
err22
errOAAI
errMa, Yuxing; Dey, Tapajit; Bogart, Chris; Amreen, Sadika; Valiev, Marat; Tutko, Adam; Kennard, David; Zaretzki, Russell; Mockus, Audris
err分享
err收藏
学者 查看更多内容