arrow
Return

RoBERTaEns: Deep Bidirectional Encoder Ensemble Model for Fact Verification

delete2022-03-22
delete1
delete
OA
AI
M
Muchammad Naseer
J
Jauzak Hussaini Windiatmaja
M
Muhamad Asvial
R
Riri Fitri Sari *
DOI:10.3390/bdcc6020033delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The application of the bidirectional encoder model to detect fake news has been widely applied because of its ability to provide factual verification with good results. Good fact verification requires the most optimal model and has the best evaluation to make news readers trust the reliable and accurate verification results. In this study, we evaluated the application of a homogeneous ensemble (HE) on RoBERTa to improve the accuracy of a model. We improve the HE method using a bagging ensemble from three types of RoBERTa models. Then, each prediction is combined to build a new model called RoBERTaEns. The FEVER dataset is used to train and test our model. The experimental results showed that the proposed method, RoBERTaEns, obtained a higher accuracy value with an F1-Score of 84.2% compared to the other RoBERTa models. In addition, RoBERTaEns has a smaller margin of error compared to the other models. Thus, it proves that the application of the HE functions increases the accuracy of a model and produces better values in handling various types of fact input in each fold.
Keywords:
fact verification
fake news
FEVER dataset
homogeneous ensemble
RoBERTa
RoBERTaEns

Journal

B
Big Data and Cognitive Computing
IF:
4.4
Papers:
1.3K
Citations:
2.4K

Organization

U
University of Indonesia
Scholars:
8.0K
Papers: 4.2K
Citations: 3.2K