arrow
返回

AI-Generated Text Detector for Arabic Language Using Encoder-Based Transformer Architecture

delete2024-03-18
delete3
delete
OA
AI
H
Hamed Alshammari
A
Ahmed El-Sayed
K
Khaled Elleithy *
DOI:10.3390/bdcc8030032delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The effectiveness of existing AI detectors is notably hampered when processing Arabic texts. This study introduces a novel AI text classifier designed specifically for Arabic, tackling the distinct challenges inherent in processing this language. A particular focus is placed on accurately recognizing human-written texts (HWTs), an area where existing AI detectors have demonstrated significant limitations. To achieve this goal, this paper utilized and fine-tuned two Transformer-based models, AraELECTRA and XLM-R, by training them on two distinct datasets: a large dataset comprising 43,958 examples and a custom dataset with 3078 examples that contain HWT and AI-generated texts (AIGTs) from various sources, including ChatGPT 3.5, ChatGPT-4, and BARD. The proposed architecture is adaptable to any language, but this work evaluates these models' efficiency in recognizing HWTs versus AIGTs in Arabic as an example of Semitic languages. The performance of the proposed models has been compared against the two prominent existing AI detectors, GPTZero and OpenAI Text Classifier, particularly on the AIRABIC benchmark dataset. The results reveal that the proposed classifiers outperform both GPTZero and OpenAI Text Classifier with 81% accuracy compared to 63% and 50% for GPTZero and OpenAI Text Classifier, respectively. Furthermore, integrating a Dediacritization Layer prior to the classification model demonstrated a significant enhancement in the detection accuracy of both HWTs and AIGTs. This Dediacritization step markedly improved the classification accuracy, elevating it from 81% to as high as 99% and, in some instances, even achieving 100%.
Keyword:
AI detector
transformer
BARD
AI-generated
AI detection
AI content
synthetic texts
ChatGPT
NLP
AIRABIC

期刊

B
Big Data and Cognitive Computing
IF:
4.4
论文数:
1.3K
被引数:
2.4K

机构

U
University of Bridgeport
学者数:
207
论文数: 182
被引数: 0
引用论文

引用论文

Chromosome-level genome assembly and annotation of the native Chinese wild blueberry <i>Vaccinium bracteatum</i>
err2022-01-01
err0
errOAAI
errLu Yang; Minghui Li; Min Shen; Sijia Bu; Bo Zhu; Feng He; Xiaoping Zhang; Xuan Gao; Jiaxin Xiao
err分享
err收藏
Granulocyte macrophage-colony stimulating factor: A key modulator of renal mononuclear phagocyte plasticity
err2019-01-01
err0
errOAAI
errKatie J. Mylonas; Jennifer Anderson; Tara A. Sheldrake; Emily E. Hesketh; James A. Richards; David A. Ferenbach; David C. Kluth; John Savill; Jeremy Hughes
err分享
err收藏
Cognitive Network Science Reveals Bias in GPT-3, GPT-3.5 Turbo, and GPT-4 Mirroring Math Anxiety in High-School Students
err2023-06-27
err16
errOAAI
errAbramski, Katherine; Citraro, Salvatore; Lombardi, Luigi; Rossetti, Giulio; Stella, Massimo
err分享
err收藏
err分享
err收藏
Forging alliances: A guide to top management
err1996-09-01
err0
PREAI
errU.Srinivasa Rangan; Michael Y. Yoshino
err分享
err收藏
A Panoramic Survey of Natural Language Processing in the Arab World
err2021-03-22
err35
errOAAI
errDarwish, Kareem; Habash, Nizar; Abbas, Mourad; Al-Khalifa, Hend; Al-Natsheh, Huseein T.; Bouamor, Houda; Bouzoubaa, Karim; Cavalli-Sforza, Violetta; El-Beltagy, Samhaa R.; El-Hajj, Wassim; Jarrar, Mustafa; Mubarak, Hamdy
err分享
err收藏
TYDI QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages
err2020-12-01
err205
errOAAI
errClark, Jonathan H.; Choi, Eunsol; Collins, Michael; Garrette, Dan; Kwiatkowski, Tom; Nikolaev, Vitaly; Palomaki, Jennimaria
err分享
err收藏
学者 查看更多内容