arrow
返回

Multi-Scale Structure-Aware Network for Weakly Supervised Temporal Action Detection

delete2021-01-01
delete22
PRE
AI
W
Wenfei Yang
张
张天柱 (Tianzhu Zhang) *
毛
毛震东 (Zhendong Mao)
张
张勇东 (Yongdong Zhang)
Qi Tian 封面图
Qi Tian (Qi Tian)
吴
吴枫 (Feng Wu)
DOI:10.1109/TIP.2021.3089361delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Weakly supervised temporal action detection has better scalability and practicability than fully supervised action detection in reality deployment. However, it is difficult to learn a robust model without temporal action boundary annotations. In this paper, we propose an en-to-end Multi-Scale Structure-Aware Network (MSA-Net) for weakly supervised temporal action detection by exploring both the global structure information of a video and the local structure information of actions. The proposed SA-Net enjoys several merits. First, to localize actions with different durations, each video is encoded into feature representations with different temporal scales. Second, based on the multi-scale feature representation, the proposed model has designed two effective structure modeling mechanisms including global structure modeling and local structure modeling, which can effectively learn discriminative structure aware representations for robust and complete action detection. To the best of our knowledge, this is the first work to fully explore the global and local structure information in a unified deep model for weakly supervised action detection. And extensive experimental results on two benchmark datasets demonstrate that the proposed MSA-Net performs favorably against state-of-the-art methods.
Keyword:
Proposals
Feature extraction
Image segmentation
Scalability
Noise measurement
Graph neural networks
GSM
Weakly supervised
action detection
multi-scale
structure-aware
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

U
university of science & technology of china, cas
学者数:
3.2W
论文数: 2.7W
被引数: 74
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Relationship Between Amyloid β Protein and Melatonin Metabolite in a Study of Electric Utility Workers
err2002-08-01
err0
PREAI
errCurtis W. Noonan; John S. Reif; James B. Burch; Travers Y. Ichinose; Michael G. Yost; Kathy Magnusson
err分享
err收藏
Timekeeping in genetically programmed aging
err1993-03-01
err0
PREAI
errP.E. Kloeden; R. Rössler; O.E. Rössler
err分享
err收藏
Materials Assessment for the Canadian SCWR Core Concept
errJOM
IF0
err2015-12-29
err0
PREAI
errWenyue Zheng; David Guzonas; Kevin P. Boyle; Jian Li; Su Xu
err分享
err收藏
Unit mechanisms of fission gas release: Current understanding and future needs
err2018-06-01
err0
errOAAI
errMichael Tonks; David Andersson; Ram Devanathan; Roland Dubourg; Anter El-Azab; Michel Freyss; Fernando Iglesias; Katalin Kulacsy; Giovanni Pastore; Simon R. Phillpot; Michael Welland
err分享
err收藏
err分享
err收藏
Preparation of Co(0001)hcpand (111)fccFilms on Single-Crystal Oxide Substrates
err2011-07-06
err0
errOAAI
errMitsuru Ohtake; Osamu Yabuhara; Yuri Nukaga; Masaaki Futamoto
err分享
err收藏
学者 查看更多内容