arrow
返回

Weakly-supervised action localization via embedding-modeling iterative optimization

delete2021-05-01
delete8
PRE
AI
X
Xiaoyu Zhang *
H
Haichao Shi
C
Changsheng Li
P
Peng Li
Z
Zekun Li
P
Peng Ren
DOI:10.1016/j.patcog.2021.107831delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Action recognition and localization in untrimmed videos in weakly supervised scenario is a challenging problem of great application prospects. Limited by the information available in video-level labels, it is a promising attempt to fully leverage the instructive knowledge learned on trimmed videos to facilitate analysis of untrimmed videos, considering that there are abundant trimmed videos which are publicly available and well segmented with semantic descriptions. In order to enforce effective trimmed untrimmed augmentation, this paper presents a novel framework of embedding-modeling iterative optimization network, referred to as IONet. In the proposed method, action classification modeling and shared subspace embedding are learned jointly in an iterative way, so that robust cross-domain knowledge transfer is achieved. With a carefully designed two-stage self-attentive representation learning workflow for untrimmed videos, irrelevant backgrounds are eliminated and fine-grained temporal relevance can be robustly explored. Extensive experiments are conducted on two benchmark datasets, i.e., THUMOS14 and ActivityNet1.3, and experimental results clearly corroborate the efficacy of our method. Source code is available on GitHub.
Keyword:
Action recognition
Temporal action localization
Attention mechanism
Generative adversarial networks
Subspace embedding
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Pattern Recognition 封面图
Pattern Recognition
IF:
7.6
论文数:
1.3W
被引数:
4.5W

机构

U
university of chinese academy of sciences, cas
学者数:
4.1W
论文数: 3.8W
被引数: 75
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Learning motion representation for real-time spatio-temporal action localization实时时空动作定位的运动表示学习
err2020-07-01
err52
PREAI
errZhang, Dejun; He, Linchao; Tu, Zhigang; Zhang, Shifu; Han, Fei; Yang, Boxiong
err分享
err收藏
A novel online action detection framework from untrimmed video streams
err2020-10-01
err15
errOAAI
errYoon, Da-Hye; Cho, Nam-Gyu; Lee, Seong-Whan
err分享
err收藏
Motion analysis: Action detection, recognition and evaluation based on motion capture data
err2018-04-01
err71
PREAI
errPatrona, Fotini; Chatzitofis, Anargyros; Zarpalas, Dimitrios; Daras, Petros
err分享
err收藏
Generative adversarial framework for depth filling via Wasserstein metric, cosine transform and domain transfer
err2019-07-01
err22
errOAAI
errAtapour-Abarghouei, Amir; Akcay, Samet; de La Garanderie, Gregoire Payen; Breckon, Toby P.
err分享
err收藏
Asymmetric 3D Convolutional Neural Networks for action recognition
err2019-01-01
err166
errOAAI
errYang, Hao; Yuan, Chunfeng; Li, Bing; Du, Yang; Xing, Junliang; Hu, Weiming; Maybank, Stephen J.
err分享
err收藏
err分享
err收藏
学者 查看更多内容