返回
Dyadic relational graph convolutional networks for skeleton-based human interaction recognition
DOI:10.1016/j.patcog.2021.107920.png)
摘要
En 中文
Skeleton-based human interaction recognition is a challenging task requiring all abilities to recognize spatial, temporal, and interactive features. These abilities rarely co-exist in existing methods. Graph convolutional network (GCN) based methods fail to extract interactive features. Traditional interaction recognition methods cannot effectively capture spatial features from skeletons. Toward this end, we propose a novel Dyadic Relational Graph Convolutional Network (DR-GCN) for interaction recognition. Specifically, we make four contributions: (i) we design a Relational Adjacency Matrix (RAM) that represents dynamic relational graphs. These graphs are constructed combining both geometric features and relative attention from the two skeleton sequences; (ii) we propose a Dyadic Relational Graph Convolution Block (DR-GCB) that extracts spatial-temporal interactive features; (iii) we stack the proposed DR-GCBs to build DR-GCN and integrate our methods with an advanced model. (iv) Our models achieve state-of-the-art results on SBU and significant improvements on the mutual action sub-datasets of NTU-RGB+D and NTU-RGB+D 120. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
3D skeleton-based interaction recognition
Multi-scale graph convolution networks
Graph inference
AI总结
对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
Learning content and style: Joint action recognition and person identification from human skeletons
PATTERN RECOGNITION
IF7.6
Structure-aware human pose estimation with graph convolutional networks基于图卷积网络的结构感知人体姿态估计
PATTERN RECOGNITION
IF7.6
Convolutional Neural Networks and Long Short-Term Memory for skeleton-based human activity and hand gesture recognition卷积神经网络和长短期记忆用于基于骨架的人体活动和手势识别
PATTERN RECOGNITION
IF7.6
New Concept of Historical Indoor Microclimate - Learning From the Past for a More Sustainable Future

