arrow
返回

Context Sensitive Network for weakly-supervised fine-grained temporal action localization

delete2025-05-01
delete0
PRE
AI
C
Cerui Dong
Q
Qinying Liu
Z
Zilei Wang *
Y
Yixin Zhang
赵峰 (Feng Zhao)
DOI:10.1016/j.neunet.2025.107140delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Weakly-supervised fine-grained temporal action localization seeks to identify fine-grained action instances in untrimmed videos using only video-level labels. The primary challenge in this task arises from the subtle distinctions among various fine-grained action categories, which complicate the accurate localization of specific action instances. In this paper, we note that the context information embedded within the videos plays a crucial role in overcoming this challenge. However, we also find that effectively integrating context information across different scales is non-trivial, as not all scales provide equally valuable information for distinguishing fine-grained actions. Based on these observations, we propose a weakly-supervised fine-grained temporal action localization approach termed the Context Sensitive Network, which aims to fully leverage context information. Specifically, we first introduce a multi-scale context extraction module designed to efficiently capture multi- scale temporal contexts. Subsequently, we develop a scale-sensitive context gating module that facilitates interaction among multi-scale contexts and adaptively selects informative contexts based on varying video content. Extensive experiments conducted on two benchmark datasets, FineGym and FineAction, demonstrate that our approach achieves state-of-the-art performance.
Keyword:
Fine-grained
Weakly supervised learning
Temporal action localization

期刊

Neural Networks 封面图
Neural Networks
IF:
6.3
论文数:
7.8K
被引数:
3.0W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 44.9W
被引数: 704
引用论文

引用论文

Structure and lattice dynamics of titanium hydrides due to thermobaric treatment
err1995-10-01
err0
PREAI
errI. O. Bashkin; A. I. Kolesnikov; E. G. Ponyatovsky
err分享
err收藏
Biochemical characterization of elite maize (Zea mays) germplasm for carotenoids composition
err2017-01-24
err0
errOAAI
errS CHANGAN; D P CHAUDHARY; S KUMAR; B KUMAR; J KAUL; S GULERIA; S L JAT; A SINGODE; M TUFCHI; S LANGYAN; O P YADAV
err分享
err收藏
Identification of clearances and stability analysis for a rotor-journal bearing system
err2008-04-01
err0
PREAI
errChris A. Papadopoulos; Pantelis G. Nikolakopoulos; George D. Gounaris
err分享
err收藏
Effect of Mn and C on Grain Growth in Mn Steels
err2018-11-29
err0
PREAI
errMadhumanti Bhattacharyya; Brian Langelier; Gary R. Purdy; Hatem S. Zurob
err分享
err收藏
err分享
err收藏
Association between comorbidities and dementia in diabetes mellitus patients: population-based retrospective cohort study
err2015-11-01
err0
PREAI
errShu-Chen Kuo; Shih-Wei Lai; Hung-Chang Hung; Chih-Hsin Muo; Shih-Chang Hung; Ling-Ling Liu; Chia-Wei Chang; Yueh-Juen Hwu; Shieh-Liang Chen; Fung-Chung Sung
err分享
err收藏
学者 查看更多内容