arrow
返回

Dyadic relational graph convolutional networks for skeleton-based human interaction recognition

delete2021-07-01
delete23
PRE
AI
L
Liping Zhu
B
Bohua Wan
C
Chengyang Li *
G
Gangyi Tian
Y
Yi Hou
K
Kun Yuan
DOI:10.1016/j.patcog.2021.107920delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Skeleton-based human interaction recognition is a challenging task requiring all abilities to recognize spatial, temporal, and interactive features. These abilities rarely co-exist in existing methods. Graph convolutional network (GCN) based methods fail to extract interactive features. Traditional interaction recognition methods cannot effectively capture spatial features from skeletons. Toward this end, we propose a novel Dyadic Relational Graph Convolutional Network (DR-GCN) for interaction recognition. Specifically, we make four contributions: (i) we design a Relational Adjacency Matrix (RAM) that represents dynamic relational graphs. These graphs are constructed combining both geometric features and relative attention from the two skeleton sequences; (ii) we propose a Dyadic Relational Graph Convolution Block (DR-GCB) that extracts spatial-temporal interactive features; (iii) we stack the proposed DR-GCBs to build DR-GCN and integrate our methods with an advanced model. (iv) Our models achieve state-of-the-art results on SBU and significant improvements on the mutual action sub-datasets of NTU-RGB+D and NTU-RGB+D 120. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
3D skeleton-based interaction recognition
Multi-scale graph convolution networks
Graph inference
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
U
University of Ottawa
学者数:
3.5W
论文数: 3.1W
被引数: 3.8W
C
china university of petroleum
学者数:
4.1W
论文数: 2.7W
被引数: 30
学者 查看更多机构
引用论文

引用论文

Quantum-based subgraph convolutional neural networks基于量子子图的卷积神经网络
err2019-04-01
err45
errOAAI
errZhang, Zhihong; Chen, Dongdong; Wang, Jianjia; Bai, Lu; Hancock, Edwin R.
err分享
err收藏
Leveraging Structural Context Models and Ranking Score Fusion for Human Interaction Prediction
err2018-07-01
err28
errOAAI
errKe, Qiuhong; Bennamoun, Mohammed; An, Senjian; Sohel, Ferdous; Boussaid, Farid
err分享
err收藏
Dynamic graph convolutional networks
err2020-01-01
err248
errOAAI
errManessi, Franco; Rozza, Alessandro; Manzo, Mario
err分享
err收藏
Dynamic graph convolutional network for multi-video summarization
err2020-11-01
err41
PREAI
errWu, Jiaxin; Zhong, Sheng-hua; Liu, Yan
err分享
err收藏
Characterization of a carboxypeptidase inhibitor from the tick Haemaphysalis longicornis
err2007-10-01
err0
PREAI
errHaiyan Gong; Jinlin Zhou; Min Liao; Takeshi Hatta; Thasaneeya Harnnoi; Rika Umemiya; Noboru Inoue; Xuenan Xuan; Kozo Fujisaki
err分享
err收藏
Structure-aware human pose estimation with graph convolutional networks基于图卷积网络的结构感知人体姿态估计
err2020-10-01
err61
PREAI
errBin, Yanrui; Chen, Zhao-Min; Wei, Xiu-Shen; Chen, Xinya; Gao, Changxin; Sang, Nong
err分享
err收藏
err分享
err收藏
学者 查看更多内容