arrow
Return

Image classification-driven speech disorder detection using deep learning technique

delete2025-06-01
delete0
PRE
AI
N
Nasser Ali Aljarallah
A
Ashit Kumar Dutta *
A
Abdul Rahaman Wahab Sait
DOI:10.1016/j.slast.2025.100261delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Speech disorders affect an individual's ability to generate sounds or utilize the voice appropriately. Neurological, developmental, physical, and trauma may cause speech disorders. Speech impairments influence communication, social interaction, education, and quality of life. Successful intervention entails early and precise diagnosis to allow for prompt treatment of these conditions. However, clinical examinations by speech-language pathologists are time-consuming, subjective, and demand an automated speech disorder detection (SDD) model. Mel- spectrogram images present a visual representation of multiple speech disorders. By classifying Mel-Spectrogram, various speech disorders can be identified. In this study, the authors proposed an image classification-based automated SDD model to classify Mel-Spectrograms to identify multiple speech disorders. Initially, Wavelet Transform (WT) hybridization technique was employed to generate Mel-Spectrogram using the voice samples. A feature extraction approach was developed using an enhanced LEVIT transformer. Finally, the extracted features were classified using an ensemble learning (EL) approach, containing CatBoost and XGBoost as base learners, and Extremely Randomized Tree as a meta learner. To reduce the computational resources, the authors used quantization-aware training (QAT). They employed Shapley Additive Explanations (SHAP) values to offer model interpretability. The proposed model was generalized using Voice ICar fEDerico II (VOICED) and LANNA datasets. The exceptional accuracy of 99.1 with limited parameters of 8.2 million demonstrated the significance of the proposed approach. The proposed model enhances speech disorder classification and offers novel prospects for building accessible, accurate, and efficient diagnostic tools. Researchers may integrate multimodal data to increase the model's use across languages and dialects, refining the proposed model for real-time clinical and telehealth deployment.
Keywords:
Speech disorders
Assistive technologies
Deep learning
Feature extraction
Vison transformer
Image classification

Journal

SLAS Technology cover
SLAS Technology
IF:
3.7
Papers:
246
Citations:
1.1K

Organization

K
King Faisal University
Scholars:
4.4K
Papers: 4.4K
Citations: 5.0K
A
Almaarefa University
Scholars:
760
Papers: 809
Citations: 1.1K
Cited Papers

Cited Papers

Transformers in medical imaging: A survey
err2023-08-01
err250
errOAAI
errShamshad, Fahad; Khan, Salman; Zamir, Syed Waqas; Khan, Muhammad Haris; Hayat, Munawar; Khan, Fahad Shahbaz; Fu, Huazhu
errShare
errSave
Vocal Feature Extraction-Based Artificial Intelligent Model for Parkinson's Disease Detection
err2021-06-11
err31
errOAAI
errHoq, Muntasir; Uddin, Mohammed Nazim; Park, Seung-Bo
errShare
errSave
Machine learning assistive application for users with speech disorders
err2021-05-01
err23
PREAI
errMulfari, Davide; Meoni, Gabriele; Marini, Marco; Fanucci, Luca
errShare
errSave
errShare
errSave
Voice disorder classification using convolutional neural network based on deep transfer learning
err2023-05-04
err17
errOAAI
errPeng, Xiangyu; Xu, Huoyao; Liu, Jie; Wang, Junlang; He, Chaoming
errShare
errSave
Voice Pathology Detection and Classification Using Convolutional Neural Network Model
err2020-05-27
err0
errOAAI
errMazin Abed Mohammed; Karrar Hameed Abdulkareem; Salama A. Mostafa; Mohd Khanapi Abd Ghani; Mashael S. Maashi; Begonya Garcia-Zapirain; Ibon Oleagordia; Hosam Alhakami; Fahad Taha AL-Dhief
errShare
errSave
researcher View more