arrow
Return

Temporal segment dropout for human action video recognition

delete2024-02-01
delete4
PRE
AI
张宇 (Yu Zhang) *
Z
Zhengjie Chen
T
Tianyu Xu
J
Junjie Zhao
米思娅 cover
米思娅 (Siya Mi)
X
Xin Geng
M
Min-Ling Zhang
DOI:10.1016/j.patcog.2023.109985delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Temporal information is important for human action video recognition. With the widely used spatio-temporal neural networks, researchers have found that the learned high-level features preserve overfitted spatial information and limited temporal information, leading to inferior performance. This is because existing networks lack efficient regularization for the temporal structure. To learn more robust temporal features, we propose a temporal regularization method named Temporal Segment Dropout (TSD). TSD drops the most salient spatial features in order to enhance the temporal features in a clip of temporal segments. Without learning from complex examples, TSD can be easily deployed in existing networks. In the experiment, TSD is extensively evaluated on benchmark action recognition datasets, which brings consistent improvements over the baselines, especially for the action-centric classes.
Keywords:
Action recognition
Temporal regularization
Temporal segment dropout

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

S
southeast university - china
Scholars:
5.3W
Papers: 4.9W
Citations: 57