arrow
返回

Spatio-temporal interactive reasoning model for multi-group activity recognition

delete2025-03-01
delete0
PRE
AI
L
Lindong Li
卿粼波 封面图
卿粼波 (Linbo Qing) *
W
Wang Tang
P
Pingyu Wang
Y
Yonghong Peng
DOI:10.1016/j.patcog.2024.111104delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Multi-group activity recognition aims to recognize sub-group activities in multi-person scenes. Existing works explore group-level features by simply using graph neural networks for reasoning about the individual interactions and directly aggregating individual features, which cannot fully mine the interactions between people and between sub-groups, resulting in the loss of useful information for group activity recognition. To address this problem, this paper proposes a Spatio-Temporal Interactive Reasoning Model (STIRM) to better exploit potential spatio-temporal interactions for multi-group activity recognition. In particular, we present an interactive feature extraction strategy to explore correlation features between individuals by analyzing the features of their nearest neighbor. We design anew clustering module that combines the action similarity feature and spatio-temporal trajectory feature to divide people into small groups. In addition, to obtain rich and accurate group-level features, a group interaction reasoning module is constructed to explore the interactions between different small groups and among people in the same group and exclude people who have less impact on group activities according to their importance. Extensive experiments on the Social-CAD, PLPS and JRDB-PAR datasets indicate the superiority of the proposed method over state-of-the-art methods.
Keyword:
Action recognition
Multi-group activity recognition
Group clustering
Interaction reasoning
Spatio-temporal trajectory

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

M
Manchester Metropolitan University
学者数:
4.4K
论文数: 5.0K
被引数: 6
A
Anglia Ruskin University
学者数:
2.6K
论文数: 2.5K
被引数: 3.3K
S
sichuan university
学者数:
12.1W
论文数: 7.8W
被引数: 100
学者 查看更多机构
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
Relationship existence recognition-based social group detection in urban public spaces
err2023-01-01
err7
errOAAI
errLi, Lindong; Qing, Linbo; Guo, Li; Peng, Yonghong
err分享
err收藏
Development of an Intelligent Digital Twins Framework for Secure Container Terminal Operations
err2021-10-14
err0
PREAI
errSergej Jakovlev; Tomas Eglynas; Miroslav Voznak; Pavol Partila; Jaromir Tovarek; Mindaugas Jusis; Edvinas Pocevicius; Zane Purlaura
err分享
err收藏
Site-specific machine learning predictive fertilization models for potato crops in Eastern Canada
err
IF0
err2020-03-12
err0
errOAAI
errZonlehoua Coulibali; Athyna Nancy Cambouris; Serge-Étienne Parent
err分享
err收藏
学者 查看更多内容