arrow
Return

A Benchmark Arabic Dataset for Arabic Question Classification using AAFAQ Framework

delete2025-08-18
delete0
delete
OA
AI
M
M. Abdel-Aziz
M
Mohanad A. Deif *
S
Shabbab Ali Algamdi *
R
Rania Elgohary
DOI:10.1038/s41597-025-05688-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Arabic Natural Language Processing (NLP) is still faced with the complexity of the language’s morphology and the limited availability of quality annotated resources. In this paper, we introduce an open-domain dataset of 5,009 Modern Standard Arabic (MSA) questions labeled according to AAFAQ framework that has11 linguistic and cognitive aspects, e.g., Question Particle, Question Particle Type, Intent, Answer Type, Cognitive Level, and Temporal Context. Based on the AAFAQ Framework (Arabic Analytical Framework for Advanced Questions), the dataset is designed to support semantic and cognitive understanding for Arabic Question Classification and related tasks. The dataset’s effectiveness was validated by fine-tuning state-of-the-art models. AraBERT achieved 100% accuracy on Question Particle Type classification and 94.95% on Intent classification. Integration within a generative question-answering system with Alpaca + Gemma-9B Unsloth improved evaluation metrics, including BLEU (+37.6%), ROUGE-1 (+132%), and BERTScore (+17.3%), validating the dataset’s value in both classification and generation tasks. Despite its broad coverage, the dataset includes underrepresented categories, e.g., Sociology and Volunteering, to be considered in future extensions. AAFAQ is a foundation benchmark for the advancement of Arabic question comprehension, with prospective applications in education, cognitive computing, and multilingual AI system creation.

Journal

Scientific Data cover
Scientific Data
IF:
6.9
Papers:
3.6K
Citations:
3.8W

Organization

C
College of Information Technology
Scholars:
79
Papers: 40
Citations: 0
F
Faculty of Computer and Information Sciences
Scholars:
56
Papers: 33
Citations: 0
C
College of Computer Science and Engineering
Scholars:
250
Papers: 113
Citations: 1
researcher View more organizations