arrow
返回

Multi-Label Code Error Classification Using CodeT5 and ML-KNN

delete2024-01-01
delete1
delete
OA
AI
M
Md Faizul Ibne Amin *
A
Atsushi Shirafuji
M
Md. Mostafizer Rahman *
Y
Yutaka Watanobe
DOI:10.1109/ACCESS.2024.3430558delete
delete原文链接
delete分享
delete收藏
摘要

摘要

En 中文
Programming is an essential skill in computer science and in a wide range of engineering-related disciplines. However, occurring errors, often referred to as bugs in code, can indeed be challenging to identify and rectify, both for students who are learning to program and for experienced professionals. These errors can lead to unexpected behaviors in programming. Understanding, finding, and effectively dealing with errors is an integral part of programming learning as well as software development. To classify the errors, we propose a multi-label error classification of source code for dealing with programming data by using the ML-KNN classifier with CodeT5 embeddings. In addition, several deep neural network (DNN) models, including GRU, LSTM, BiLSTM, and BiLSTM-A (attention mechanism) are also employed as baseline models to classify the errors. We trained all the models by using a large-scale dataset (original error labels) as well as modified datasets (summarized error labels) of the source code. The average classification accuracy of the proposed model is 95.91% and 84.77% for the original and summarized error-labeled datasets, respectively. The exact match accuracy is 22.57% and 27.22% respectively for the original and summarized error-labeled datasets. The comprehensive experimental results of the proposed approach are promising for multi-label error classification over the baseline models. Moreover, the findings derived from the proposed approach and data-driven analytical results hold significant promise for error classification, programming education, and related research endeavors.
Keyword:
Programming profession
Codes
Accuracy
Source coding
Education
Task analysis
Machine learning
Big Data
Error analysis
Learning systems
Software engineering
CodeT5
data analysis
educational big data
error classification
learning analytics
ML-KNN
multi-label classification
programming learning
software engineering

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

U
University of Aizu
学者数:
768
论文数: 1.0K
被引数: 302
引用论文

引用论文

Sentiment Classification Using a Single-Layered BiLSTM Model
err2020-01-01
err121
errOAAI
errHameed, Zabit; Garcia-Zapirain, Begonya
err分享
err收藏
Deep Learning-based Text Classification: A Comprehensive Review基于深度学习的文本分类综述
err2021-04-17
err587
PREAI
errMinaee, Shervin; Kalchbrenner, Nal; Cambria, Erik; Nikzad, Narjes; Chenaghlu, Meysam; Gao, Jianfeng
err分享
err收藏
ML-FOREST: A Multi-Label Tree Ensemble Method for Multi-Label Classification
err2016-10-01
err70
PREAI
errWu, Qingyao; Tan, Mingkui; Song, Hengjie; Chen, Jian; Ng, Michael K.
err分享
err收藏
学者 查看更多内容