arrow
返回

Compact Representation and Reliable Classification Learning for Point-Level Weakly-Supervised Action Localization

delete2022-01-01
delete8
PRE
AI
J
Jie Fu
J
Junyu Gao
徐
徐常胜 (Changsheng Xu) *
DOI:10.1109/TIP.2022.3222623delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Point-level weakly-supervised temporal action localization (P-WSTAL) aims to localize temporal extents of action instances and identify the corresponding categories with only a single point label for each action instance for training. Due to the sparse frame-level annotations, most existing models are in the localization-by-classification pipeline. However, there exist two major issues in this pipeline: large intra-action variation due to task gap between classification and localization and noisy classification learning caused by unreliable pseudo training samples. In this paper, we propose a novel framework CRRC-Net, which introduces a co-supervised feature learning module and a probabilistic pseudo label mining module, to simultaneously address the above two issues. Specifically, the co-supervised feature learning module is applied to exploit the complementary information in different modalities for learning more compact feature representations. Furthermore, the probabilistic pseudo label mining module utilizes the feature distances from action prototypes to estimate the likelihood of pseudo samples and rectify their corresponding labels for more reliable classification learning. Comprehensive experiments are conducted on different benchmarks and the experimental results show that our method achieves favorable performance with the state-of-the-art.
Keyword:
Compact representation
reliable classification
point-level weakly-supervised action localization

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

Z
Zhengzhou University
学者数:
6.8W
论文数: 4.4W
被引数: 8.5W
C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Gorlin syndrome and desmoplastic medulloblastoma: Report of 3 cases with unfavorable clinical course and novel mutations
err2015-05-04
err0
errOAAI
errSridharan Gururangan; Giles Robinson; David W. Ellison; Gang Wu; Xuelian He; Q. Richard Lu; Roger McLendon; Gerald Grant; Timothy Driscoll; Ronnie Neuberg
err分享
err收藏
err分享
err收藏
Analysis on topological grain forms via large-scale serial sectioning experiment and Monte Carlo simulation
err2016-07-01
err0
PREAI
errWeihua Xue; Hao Wang; Guoquan Liu; Li Meng; Guang Ma; Minnan Feng
err分享
err收藏
err分享
err收藏
Modeling Sub-Actions for Weakly Supervised Temporal Action Localization
err2021-01-01
err24
PREAI
errHuang, Linjiang; Huang, Yan; Ouyang, Wanli; Wang, Liang
err分享
err收藏
学者 查看更多内容