arrow
返回

Normalize d e dge convolutional networks for skeleton-based hand gesture recognition

delete2021-10-01
delete20
PRE
AI
F
Fangtai Guo
Z
Zaixing He *
S
Shuyou Zhang
X
Xinyue Zhao
J
Jinhui Fang
J
Jianrong Tan
DOI:10.1016/j.patcog.2021.108044delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Dynamic hand skeletons consisting of discrete spatial-temporal finger joint clouds effectively convey the intentions of communicators. Previous graph convolutional networks (GCNs) relying on human handcrafted inductive biases have been quickly promoted for skeleton-based hand gesture recognition (SHGR). However, most existing graph constructions for GCN-based solutions are set manually, only considering the physical topology of the hand skeleton, and the fixed dependencies among hand joints may lead to suboptimal models. To enrich the local dependencies, we emphasize that hand skeletons can be seen from two views: explicit joint clouds and implicit skeleton topology. Starting from those two views of hand gestures, we attempt to introduce dynamics and diversities into the local neighborhood of the graph by dividing it into sets of physical neighbors, temporal neighbors and varying neighbors. Next, we systematically proceed with three innovations, including the novel edge-varying graph, normalized edge convolution operation, and zig-zag sampling strategy, to alleviate the challenges resulting from engineering practices. Finally, spatial-based GCNs called normalized edge convolutional networks are constructed for hand gesture recognition. Experiments on publicly available hand datasets show that our work is stable for performing state-of-the-art gesture recognition, and ablation experiments are also provided to validate each contribution. (c) 2021 Published by Elsevier Ltd.
Keyword:
Skeleton-based hand gesture recognition
Edge-varying graph
Normalized edge convolution
Zig-zag sampling strategy
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

err分享
err收藏
Absence of mutations in the LGI1 receptor ADAM22 gene in autosomal dominant lateral temporal epilepsy
err2007-08-01
err0
PREAI
errElodie Chabrol; Isabelle Gourfinkel-An; Ingrid E. Scheffer; Fabienne Picard; Philippe Couarch; Samuel F. Berkovic; Jacinta M. McMahon; Nandita Bajaj; Luisa Mota-Vieira; Rui Mota; Oriane Trouillard; Christel Depienne; Michel Baulac; Eric LeGuern; Stéphanie Baulac
err分享
err收藏
err分享
err收藏
Graph convolutional network with structure pooling and joint-wise channel attention for action recognition
err2020-07-01
err50
PREAI
errChen, Yuxin; Ma, Gaoqun; Yuan, Chunfeng; Li, Bing; Zhang, Hui; Wang, Fangshi; Hu, Weiming
err分享
err收藏
MFA-Net: Motion Feature Augmented Network for Dynamic Hand Gesture Recognition from Skeletal Data
errSENSORS
IF3.5
err2019-01-10
err58
errOAAI
errChen, Xinghao; Wang, Guijin; Guo, Hengkai; Zhang, Cairong; Wang, Hang; Zhang, Li
err分享
err收藏
Learning graph structure via graph convolutional networks通过图卷积网络学习图结构
err2019-11-01
err46
PREAI
errZhang, Qi; Chang, Jianlong; Meng, Gaofeng; Xu, Shibiao; Xiang, Shiming; Pan, Chunhong
err分享
err收藏
没有更多内容