arrow
返回

Deep multiple aggregation networks for action recognition

delete2024-02-01
delete3
PRE
AI
A
Ahmed Cherif Mazari
H
Hichem Sahbi *
DOI:10.1007/s13735-023-00317-1delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Most of the current action recognition algorithms are based on deep networks which stack multiple convolutional, pooling and fully connected layers. While convolutional and fully connected operations have been widely studied in the literature, the design of pooling operations that handle action recognition, with different sources of temporal granularity in action categories, has comparatively received less attention, and existing solutions rely mainly on max or averaging operations. The latter are clearly powerless to fully exhibit the actual temporal granularity of action categories and thereby constitute a bottleneck in classification performances. In this paper, we introduce a novel hierarchical pooling design that captures different levels of temporal granularity in action recognition. Our design principle is coarse-to-fine and achieved using a tree-structured network; as we traverse this network top-down, pooling operations are getting less invariant but timely more resolute and well localized. Learning the combination of operations in this network-which best fits a given ground-truth-is obtained by solving a constrained minimization problem whose solution corresponds to the distribution of weights that capture the contribution of each level (and thereby temporal granularity) in the global hierarchical pooling process. Besides being principled and well grounded, the proposed hierarchical pooling is also video-length and resolution agnostic. Extensive experiments conducted on the challenging UCF-101, HMDB-51 and JHMDB-21 databases corroborate all these statements.
Keyword:
Multiple aggregation design
2-Stream networks
Action recognition

期刊

International Journal of Multimedia Information Retrieval 封面图
International Journal of Multimedia Information Retrieval
IF:
2.9
论文数:
279
被引数:
866

机构

S
Sorbonne Universite
学者数:
6.2W
论文数: 4.5W
被引数: 605
引用论文

引用论文

Saturation variant interpretation using CRISPR prime editing
err
IF0
err2021-05-14
err0
errOAAI
errSteven Erwood; Teija M.I. Bily; Jason Lequyer; Joyce Yan; Nitya Gulati; Reid A. Brewer; Liangchi Zhou; Laurence Pelletier; Evgueni A. Ivakine; Ronald D. Cohn
err分享
err收藏
Incentive mechanisms for smartphone collaboration in data acquisition and distributed computing
err2012-03-01
err0
PREAI
errLingjie Duan; Takeshi Kubo; Kohei Sugiyama; Jianwei Huang; Teruyuki Hasegawa; Jean Walrand
err分享
err收藏
Late diagenesis of illite-smectite in the Podhale Basin, southern Poland: Chemistry, morphology, and preferred orientation
err2017-10-05
err0
errOAAI
errRuarri J. Day-Stirrat; Andrew C. Aplin; Kuncho D. Kurtev; Anja M. Schleicher; Andrew P. Brown; Jan Środoń
err分享
err收藏
Spatio-Temporal Attention Networks for Action Recognition and Detection用于动作识别和检测的时空注意网络
err2020-11-01
err113
PREAI
errLi, Jun; Liu, Xianglong; Zhang, Wenxuan; Zhang, Mingyuan; Song, Jingkuan; Sebe, Nicu
err分享
err收藏
The mental health of staff working in intensive care during COVID-19
err
IF0
err2020-11-04
err0
errOAAI
errNeil Greenberg; Dale Weston; Charlotte Hall; Tristan Caulfield; Victoria Williamson; Kevin Fong
err分享
err收藏
Click‐evoked vestibulocollic reflexes in torticollis
err2004-10-12
err0
PREAI
errJ. G. Colebatch; V. Di Lazzaro; A. Quartarone; J. C. Rothwell; M. Gresty
err分享
err收藏
学者 查看更多内容