.png){kind=icon}
返回
GPTSniffer: A CodeBERT-based classifier to detect source code written by ChatGPT
.png){kind=icon}
OA
AI
DOI：10.1016/j.jss.2024.112059.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Since its launch in November 2022, ChatGPT has gained popularity among users, especially programmers who use it to solve development issues. However, while offering a practical solution to programming problems, ChatGPT should be used primarily as a supporting tool (e.g., in software education) rather than as a replacement for humans. Thus, detecting automatically generated source code by ChatGPT is necessary, and tools for identifying AI -generated content need to be adapted to work effectively with code. This paper presents GPTSniffer- a novel approach to the detection of source code written by AI - built on top of CodeBERT. We conducted an empirical study to investigate the feasibility of automated identification of AI -generated code, and the factors that influence this ability. The results show that GPTSniffer can accurately classify whether code is human -written or AI -generated, outperforming two baselines, GPTZero and OpenAI Text Classifier. Also, the study shows how similar training data or a classification context with paired snippets helps boost the prediction. We conclude that GPTSniffer can be leveraged in different contexts, e.g., in software engineering education, where teachers use the tool to detect cheating and plagiarism, or in development, where AI -generated code may require peculiar quality assurance activities.
Keyword:
ChatGPT
Code classification
CodeBERT
Pre-trained Models
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.1
论文数:
5.5K
被引数:
8.4K
机构
引用论文
Nonparametric pairwise multiple comparisons in independent groups using Dunn's test.png)
STATA JOURNALOAAI
STATA JOURNALIF2.4
OAAI分享收藏Analysis of Key Factors Affecting Ethanol Production by Saccharomyces
cerevisiae IFST-072011影响酿酒酵母产乙醇的关键因素分析
酿酒IFST-072011
PREAI
分享收藏
查看更多内容