arrow
Return

LLM-generated scientific content detection method

delete2026-09-09
delete0
PRE
AI
A
Arwa Bader *
B
Bushra Alhijawi
DOI:10.1007/s00521-026-12465-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Large language models (LLMs), such as ChatGPT, Gemini, and LLaMA-3, can generate scientific text that closely resembles human-written text. While they simplify the creation of research papers and articles, they also raise concerns about plagiarism, misinformation, and academic dishonesty. Detecting AI-generated content is therefore crucial for maintaining scientific integrity. This study introduces the Artificial Intelligence Scientific Text Detector (AISciDetector), a hybrid model combining BigBird embeddings with a CNN-BiLSTM framework. BigBird captures long-range dependencies in scientific texts. The CNN extracts local features, and the BiLSTM models sequential patterns in both directions. The model performs binary classification to distinguish human-written from LLM-generated text. We also present LLMSciTxt, a dataset containing scientific texts by human authors and outputs from ChatGPT, Gemini, and LLaMA-3. Experiments show that AISciDetector achieves an accuracy of 91.5% and an F1-score of 91.49%, outperforming classical machine learning and transformer-based models. These results demonstrate that AISciDetector can effectively identify LLM-generated content, supporting the integrity and credibility of academic publications.
Keywords:
Large language models
Scientific content
Academic plagiarism detection
Transformer
Deep learning

Journal

Neural Computing and Applications cover
Neural Computing and Applications
IF:
4.5
Papers:
863
Citations:
3.2W

Organization

P
Princess Sumaya University for Technology
Scholars:
415
Papers: 379
Citations: 174
Cited Papers

Cited Papers

Deep Learning for Intelligent Human–Computer Interaction
err2022-11-11
err0
errOAAI
errZhihan Lv; Fabio Poiesi; Qi Dong; Jaime Lloret; Houbing Song
errShare
errSave
Testing of detection tools for AI-generated text
err2023-12-25
err70
errOAAI
errWeber-Wulff, Debora; Anohina-Naumeca, Alla; Bjelobaba, Sonja; Foltynek, Tomas; Guerrero-Dib, Jean; Popoola, Olumide; Sigut, Petr; Waddington, Lorna
errShare
errSave
errShare
errSave
Natural language processing: an introduction
err2011-09-01
err0
errOAAI
errPrakash M Nadkarni; Lucila Ohno-Machado; Wendy W Chapman
errShare
errSave
Exploring ChatGPT Capabilities and Limitations: A Survey
err2023-01-01
err25
errOAAI
errKoubaa, Anis; Boulila, Wadii; Ghouti, Lahouari; Alzahem, Ayyub; Latif, Shahid
errShare
errSave
Robust Natural Language Processing: Recent Advances, Challenges, and Future Directions
err2022-01-01
err15
errOAAI
errOmar, Marwan; Choi, Soohyeon; Nyang, Daehun; Mohaisen, David
errShare
errSave
Benchmarking Large Language Models for News Summarization
err2024-01-31
err48
errOAAI
errZhang, Tianyi; Ladhak, Faisal; Durmus, Esin; Liang, Percy; Mckeown, Kathleen; Hashimoto, Tatsunori B.
errShare
errSave
researcher View more