返回
Normalize d e dge convolutional networks for skeleton-based hand gesture recognition
DOI:10.1016/j.patcog.2021.108044.png)
摘要
En 中文
Dynamic hand skeletons consisting of discrete spatial-temporal finger joint clouds effectively convey the intentions of communicators. Previous graph convolutional networks (GCNs) relying on human handcrafted inductive biases have been quickly promoted for skeleton-based hand gesture recognition (SHGR). However, most existing graph constructions for GCN-based solutions are set manually, only considering the physical topology of the hand skeleton, and the fixed dependencies among hand joints may lead to suboptimal models. To enrich the local dependencies, we emphasize that hand skeletons can be seen from two views: explicit joint clouds and implicit skeleton topology. Starting from those two views of hand gestures, we attempt to introduce dynamics and diversities into the local neighborhood of the graph by dividing it into sets of physical neighbors, temporal neighbors and varying neighbors. Next, we systematically proceed with three innovations, including the novel edge-varying graph, normalized edge convolution operation, and zig-zag sampling strategy, to alleviate the challenges resulting from engineering practices. Finally, spatial-based GCNs called normalized edge convolutional networks are constructed for hand gesture recognition. Experiments on publicly available hand datasets show that our work is stable for performing state-of-the-art gesture recognition, and ablation experiments are also provided to validate each contribution. (c) 2021 Published by Elsevier Ltd.
Keyword:
Skeleton-based hand gesture recognition
Edge-varying graph
Normalized edge convolution
Zig-zag sampling strategy
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Attention-Based Pose Sequence Machine for 3D Hand Pose Estimation基于注意力的姿态序列机的手部三维姿态估计
IEEE ACCESS
IF3.6
Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures利用递归神经网络和Leap运动控制器识别手语和信号手势
Hand joints-based gesture recognition for noisy dataset using nested interval unscented Kalman filter with LSTM network基于LSTM网络的嵌套区间无迹卡尔曼滤波器对噪声数据集的手势识别
VISUAL COMPUTER
IF2.9
Graph convolutional network with structure pooling and joint-wise channel attention for action recognition
PATTERN RECOGNITION
IF7.6
MFA-Net: Motion Feature Augmented Network for Dynamic Hand Gesture Recognition from Skeletal Data
SENSORS
IF3.5
Convolutional Neural Networks and Long Short-Term Memory for skeleton-based human activity and hand gesture recognition卷积神经网络和长短期记忆用于基于骨架的人体活动和手势识别
PATTERN RECOGNITION
IF7.6
没有更多内容

