arrow
Return

Hypergraph Neural Network for Skeleton-Based Action Recognition

delete2021-01-01
delete65
PRE
AI
郝小可 (Xiaoke Hao)
J
Jie Li
郭迎春 (Yingchun Guo) *
T
Tao Jiang
于明 cover
于明 (Ming Yu)
DOI:10.1109/TIP.2021.3051495delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Recently, skeleton-based human action recognition has attracted a lot of research attention in the field of computer vision. Graph convolutional networks (GCNs), which model the human body skeletons as spatial-temporal graphs, have shown excellent results. However, the existing methods only focus on the local physical connection between the joints, and ignore the non-physical dependencies among joints. To address this issue, we propose a hypergraph neural network (Hyper-GNN) to capture both spatial-temporal information and high-order dependencies for skeleton-based action recognition. In particular, to overcome the influence of noise caused by unrelated joints, we design the Hyper-GNN to extract the local and global structure information via the hyperedge (i.e., non-physical connection) constructions. In addition, the hypergraph attention mechanism and improved residual module are induced to further obtain the discriminative feature representations. Finally, a three-stream Hyper-GNN fusion architecture is adopted in the whole framework for action recognition. The experimental results performed on two benchmark datasets demonstrate that our proposed method can achieve the best performance when compared with the state-of-the-art skeleton-based methods.
Keywords:
Skeleton
Feature extraction
Convolution
Joints
Hidden Markov models
Three-dimensional displays
Neural networks
Skeleton-based action recognition
hypergraph neural network
hypergraph attention mechanism
geometric relations
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

H
hebei university of technology
Scholars:
1.8W
Papers: 1.2W
Citations: 10