arrow
返回

Understanding vision-based continuous sign language recognition

delete2020-05-17
delete42
PRE
AI
N
Neena Aloysius *
DOI:10.1007/s11042-020-08961-zdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Real-time sign language translation systems, that convert continuous sign sequences to text/speech, will facilitate communication between the deaf-mute community and the normal hearing majority. A translation system could be vision-based or sensor-based, depending on the type of input it receives. To date, most of the commercial systems for this purpose are sensor-based, which are expensive and not user-friendly. Vision-based sign translation systems are the need of the hour but should overcome many challenges to build a full-fledged working system. Preliminary investigations in this work have revealed that the traditional approaches to continuous sign language recognition (CSLR) using HMM, CRF and DTW, tried to solve the problem of Isolated Sign Language Recognition (ISLR) and extended the solution to CSLR, leading to reduced performance. The main challenge of identifying Movement Epenthesis (ME) segments in continuous utterances, were handled explicitly with these traditional methods. With the advent of technologies like Deep Learning, more feasible solutions for vision-based CSLR are emerging, which has led to an increase in the research on vision-based approaches. In this paper, a detailed review of all the works in vision-based CSLR is presented, based on the methods they have followed. The challenges posed in continuous sign recognition are also discussed in detail, followed by a brief on sensor-based systems and benchmark databases. Finally, performance evaluation of all the associated methods are performed, which leads to a short discussion on the overall study and concludes by pointing out future research directions in the field.
Keyword:
Continuous sign language
Vision-based
Movement epenthesis
Review
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Multimedia Tools and Applications 封面图
Multimedia Tools and Applications
IF:
3
论文数:
2.0W
被引数:
3.2W

机构

A
Amrita Vishwa Vidyapeetham
学者数:
7.0K
论文数: 4.2K
被引数: 3.3K
引用论文

引用论文

err分享
err收藏
Incentive mechanisms for smartphone collaboration in data acquisition and distributed computing
err2012-03-01
err0
PREAI
errLingjie Duan; Takeshi Kubo; Kohei Sugiyama; Jianwei Huang; Teruyuki Hasegawa; Jean Walrand
err分享
err收藏
Do wildlife crimes against less charismatic species go unnoticed? A case study of Golden Jackal Canis aureus Linnaeus, 1758 poaching and trade in India
err2020-03-26
err0
errOAAI
errMalaika Mathew Chawla; Arjun Srivathsa; Priya Singh; Iravatee Majgaonkar; Sushma Sharma; Girish Punjabi; Aditya Banerjee
err分享
err收藏
Synthesis of functionalized de novo designed 8–16 kDa model proteins towards metal ion-binding and esterase activity
err2007-01-01
err0
PREAI
errA. Pernille Tofteng; Thomas H. Hansen; Jesper Brask; John Nielsen; Peter W. Thulstrup; Knud J. Jensen
err分享
err收藏
DESIGN AND REALIZATION OF A FLAT-TOP SHAPED-BEAM ANTENNA ARRAY
err2008-01-01
err0
errOAAI
errHai-Jin Zhou; You-Huo Huang; Bao-Hua Sun; Qi-Zhong Liu
err分享
err收藏
Resolving hand over face occlusion
err2007-09-01
err11
PREAI
errSmith, Paul; Lobo, Niels da Vitoria; Shah, Mubarak
err分享
err收藏
学者 查看更多内容