.png){kind=icon}
返回
Position-Aware Participation-Contributed Temporal Dynamic Model for Group Activity Recognition
.png){kind=icon}
PRE
AI
DOI：10.1109/TNNLS.2021.3085567.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Group activity recognition (GAR) aiming at understanding the behavior of a group of people in a video clip has received increasing attention recently. Nevertheless, most of the existing solutions ignore that not all the persons contribute to the group activity of the scene equally. That is to say, the contribution from different individual behaviors to group activity is different; meanwhile, the contribution from people with different spatial positions is also different. To this end, we propose a novel Position-aware Participation-Contributed Temporal Dynamic Model ((PCTDM)-C-2), in which two types of the key actor are constructed and learned. Specifically, we focus on the behaviors of key actors, who maintain steady motions (long moving time, called long motions) or display remarkable motions (but closely related to other people and the group activity, called flash motions) at a certain moment. For capturing long motions, we rank individual motions according to their intensity measured by stacking optical flows. For capturing flash motions that are closely related to other people, we design a position-aware interaction module (PIM) that simultaneously considers the feature similarity and position information. Beyond that, for capturing flash motions that are highly related to the group activity, we also present an aggregation long short-term memory (Agg-LSTM) to fuse the outputs from PIM by time-varying trainable attention factors. Four widely used benchmarks are adopted to evaluate the performance of the proposed (PCTDM)-C-2 compared to the state of the art.
Keyword:
Feature extraction
Activity recognition
Logic gates
Spatiotemporal phenomena
Dynamics
Computer vision
Visualization
Attention mechanism
graph neural network (GNN)
group activity recognition (GAR)
scene understanding
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
.png){kind=icon}
A prospective study of surgical margin status in oral squamous cell carcinoma: A preliminary report
PREAI
分享收藏
查看更多内容