arrow
Return

Machine learning assistive application for users with speech disorders

delete2021-05-01
delete23
PRE
AI
D
Davide Mulfari *
G
Gabriele Meoni
M
Marco Marini
L
Luca Fanucci
DOI:10.1016/j.asoc.2021.107147delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This paper investigates machine learning approaches toward the development of a speaker dependent keywords spotting system intended for users with speech disorders, in particular for those with dysarthria, i.e., a neuromotor speech impairment associated with severe physical disabilities. In the field of assistive technologies, nowadays automatic speech recognition (ASR) is an open challenge since standard voice recognition approaches and voice driven services are ineffective to recognize atypical speech. To address these issues, we focus our attention on keywords spotting task in presence of dysarthria and we exploit deep learning technology in conjunction with an existing convolutional neural network model to build a tailored ASR system for users with such speech disabilities. However, the usage of a machine learning approach requires enough data availability for the training of the model; to this aim, we introduce a mobile software (app) allowing those with speech disorders to collect their audio contribution in order to enrich the speech model. Considering Italian as main language, this approach allows us to build the first database containing speech samples from Italian native users with dysarthria. As discussed in the end of the article, early experiments show promising results and give us interesting perspectives for future research directions. (C) 2021 Elsevier B.V. All rights reserved.
Keywords:
Assistive technology
Automatic speech recognition
Dysarthria
Machine learning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Applied Soft Computing cover
Applied Soft Computing
IF:
6.6
Papers:
1.4W
Citations:
4.8W

Organization

U
University of Pisa
Scholars:
3.1W
Papers: 2.4W
Citations: 2.4W
U
University of Messina
Scholars:
1.5W
Papers: 1.1W
Citations: 1.1W