.png){kind=icon}
返回
First-Person Hand Action Recognition Using Multimodal Data
.png){kind=icon}
PRE
AI
DOI：10.1109/TCDS.2021.3108136.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Extensive studies have been conducted on human action recognition, whereas relatively few methods have been proposed for hand action recognition. Although it is very natural and straightforward to apply a human action recognition method to hand action recognition, this approach cannot always lead to state-of-the-art performance. One of the important reasons is that both the between-class difference and the within-class difference in hand actions are much smaller than those in human actions. In this article, we study first-person hand action recognition from RGB-D sequences. To explore whether pretrained networks substantially influence accuracy, eight classic pretrained networks and one pretrained network designed by us are introduced for extracting RGB-D features. A Lie group is introduced for hand pose representation. Ablation studies are conducted to compare the discriminative power of the RGB modality, depth modality, pose modality, and their combinations. In our method, a fixed number of frames are randomly sampled to represent an action. This temporal modeling strategy is simple but is proven more effective than both the graph convolutional network (GCN) and the recurrent neural network (RNN), which are widely adopted by conventional methods. Evaluation experiments on two public data sets demonstrate that our method markedly outperforms recent baselines.
Keyword:
Feature extraction
Image recognition
Optical flow
Streaming media
Indexes
Training data
Data models
Transfer learning
Action recognition
human-object interaction
multimodal data
transfer learning
期刊
IF:
4.9
论文数:
1.1K
被引数:
3.5K
机构
引用论文
Incentive mechanisms for smartphone collaboration in data acquisition and distributed computing
.png){kind=icon}
PREAI
分享收藏
分享收藏
查看更多内容