.png){kind=icon}
返回
Source Code Error Understanding Using BERT for Multi-Label Classification
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2024.3525061.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Programming is an essential skill in computer science and across a wide range of engineering disciplines. However, errors, often referred to as 'bugs' in code, can be challenging to identify and rectify for both students learning to program and experienced professionals. Understanding, identifying, and effectively addressing these errors are critical aspects of programming education and software development. To aid in understanding and classifying these errors, we propose a multi-label error classification approach for source code using fine-tuned BERT models (BERT_Uncased and BERT_Cased). The models achieved average classification accuracies of 90.58% and 90.80%, exact match accuracies of 48.28% and 49.13%, and weighted F1 scores of 0.796 and 0.799, respectively. Precision, Recall, Hamming Loss, and ROC-AUC metrics further evaluate the effectiveness of our models. Additionally, we employed several combinations of large language models (CodeT5, CodeBERT) with machine learning classifiers (Decision Tree, Random Forest, Ensemble Learning, ML-KNN), demonstrating the superiority of our proposed approach. These findings highlight the potential of multi-label error classification to advance programming education, software engineering, and related research fields.
Keyword:
Programming
Programming profession
Codes
Multi label classification
Accuracy
Education
Transformers
Measurement
Computer bugs
Data models
Multi-label classification
BERT
CodeT5
CodeBERT
decision tree
random forest
ML-KNN
ensemble learning
data analysis
educational big data
error classification
learning analytics
programming learning
software engineering
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Dual-frequency ultrasound detection and sizing of microbubbles for studying decompression sickness.双频超声检测与微泡尺寸测量在减压病研究中的应用。.png)
IF0
PREAI
分享收藏THE MEANING AND USE OF THE AREA UNDER A RECEIVER OPERATING CHARACTERISTIC (ROC) CURVE受试者工作特征 (ROC) 曲线下面积的含义和用途RADIOLOGY
RADIOLOGYIF15.2
PREAI
分享收藏Bangla-BERT: Transformer-Based Efficient Model for Transfer Learning and Language UnderstandingIEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏MG-GCN: Multi-Granularity Graph Convolutional Neural Network for Multi-Label Classification in Multi-Label Information SystemMg-gcn: 多标签信息系统中多标签分类的多粒度图卷积神经网络
PREAI
分享收藏Identifying algorithm in program code based on structural features using CNN classification model基于CNN分类模型的程序代码结构特征识别算法APPLIED INTELLIGENCEOAAI
APPLIED INTELLIGENCEIF3.5
OAAI分享收藏A recommendation approach for programming online judges supported by data preprocessing techniques数据预处理技术支持的在线法官编程推荐方法APPLIED INTELLIGENCE
APPLIED INTELLIGENCEIF3.5
PREAI
分享收藏Concentrations of Ovarian and Pituitary Hormones Following Prostaglandin F2α-Induced Luteal Regression in Ewes Varies with Day of the Estrous Cycle at Treatment1在绵羊中，通过前列腺素F2α诱导黄体退化后，卵巢和垂体激素的浓度随着发情周期内治疗日的不同而变化。
PREAI
分享收藏
查看更多内容