Deepsign: Sign Language Detection and Recognition Using Deep Learning

doi:10.3390/electronics11111780

Deepsign: Sign Language Detection and Recognition Using Deep Learning

2022-06-03

0

OA

AI

DOI：10.3390/electronics11111780

原文链接

原文求助

摘要

En 中文

The predominant means of communication is speech; however, there are persons whose speaking or hearing abilities are impaired. Communication presents a significant barrier for persons with such disabilities. The use of deep learning methods can help to reduce communication barriers. This paper proposes a deep learning-based model that detects and recognizes the words from a person’s gestures. Deep learning models, namely, LSTM and GRU (feedback-based learning models), are used to recognize signs from isolated Indian Sign Language (ISL) video frames. The four different sequential combinations of LSTM and GRU (as there are two layers of LSTM and two layers of GRU) were used with our own dataset, IISL2020. The proposed model, consisting of a single layer of LSTM followed by GRU, achieves around 97% accuracy over 11 different signs. This method may help persons who are unaware of sign language to communicate with persons whose speech or hearing is impaired.

Deepsign: Sign Language Detection and Recognition Using Deep Learning

摘要

期刊

机构

引用论文