返回
Deep multiple aggregation networks for action recognition
DOI:10.1007/s13735-023-00317-1.png)
摘要
En 中文
Most of the current action recognition algorithms are based on deep networks which stack multiple convolutional, pooling and fully connected layers. While convolutional and fully connected operations have been widely studied in the literature, the design of pooling operations that handle action recognition, with different sources of temporal granularity in action categories, has comparatively received less attention, and existing solutions rely mainly on max or averaging operations. The latter are clearly powerless to fully exhibit the actual temporal granularity of action categories and thereby constitute a bottleneck in classification performances. In this paper, we introduce a novel hierarchical pooling design that captures different levels of temporal granularity in action recognition. Our design principle is coarse-to-fine and achieved using a tree-structured network; as we traverse this network top-down, pooling operations are getting less invariant but timely more resolute and well localized. Learning the combination of operations in this network-which best fits a given ground-truth-is obtained by solving a constrained minimization problem whose solution corresponds to the distribution of weights that capture the contribution of each level (and thereby temporal granularity) in the global hierarchical pooling process. Besides being principled and well grounded, the proposed hierarchical pooling is also video-length and resolution agnostic. Extensive experiments conducted on the challenging UCF-101, HMDB-51 and JHMDB-21 databases corroborate all these statements.
Keyword:
Multiple aggregation design
2-Stream networks
Action recognition
期刊
IF:
2.9
论文数:
279
被引数:
866
机构
引用论文
Spatial-temporal pyramid based Convolutional Neural Network for action recognition基于时空金字塔的卷积神经网络动作识别
NEUROCOMPUTING
IF6.5
Late diagenesis of illite-smectite in the Podhale Basin, southern Poland: Chemistry, morphology, and preferred orientation
Geosphere
IF0

