.png){kind=icon}
Return
Dynamical Attention Hypergraph Convolutional Network for Group Activity Recognition
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2024.3422265.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Recently, group activity recognition (GAR) has drawn growing interests in video analysis and computer vision communities. The current models of GAR tasks are often impractical in that they suppose that all interactions between actors are pairwise, which only models and leverages part of the information in real entire interactions. Motivated by this, we design a distinct dynamical attention hypergraph convolutional network framework, referred to as DAHGCN, for precise GAR, modeling the entire interactions and capturing the high-order relationships among involved actors in a real-life scenario. Specifically, to learn complementary feature representations for fine-grained GAR, a multilevel feature descriptor (MLFD) module is proposed. Furthermore, for learning higher order interaction relationships, we construct a DAHGCN to accommodate complex group interactions, which can dynamically change the topology of the hypergraph and learn these key representations by virtue of the similarity-based shared nearest-neighbor (SSNN) clustering and attention mechanisms on hypergraph. Finally, a multiscale temporal convolution (MSTC) module is utilized to explore various long-range temporal dynamic correlations across different frames. In addition, comprehensive experiments on three commonly used GAR datasets clearly demonstrate that, when compared with the state-of-the-art methods, our proposed method can achieve the most optimal performance.
Keywords:
Group activity recognition (GAR)
higher order interaction relationships
hypergraph
multiscale temporal convolution (MSTC) module
self-attention
Group activity recognition (GAR)
higher order interaction relationships
hypergraph
multiscale temporal convolution (MSTC) module
self-attention
Journal
IF:
8.9
Papers:
7.6K
Citations:
7.2W
Organization
View more organizations
Cited Papers
No cited papers available