A Collaborative Hierarchical Aggregation Network for Weakly Supervised Temporal Action Localization

doi:10.1145/3778170

A Collaborative Hierarchical Aggregation Network for Weakly Supervised Temporal Action Localization

2026-01-01

0

PRE

AI

DOI：10.1145/3778170

Original request for help

Save

Abstract

En 中文

Temporal action localization is a fundamental task in video understanding that focuses on classifying and temporally localizing action instances in untrimmed videos. Compared to temporal action localization, the data lacks detailed information about action boundaries. Existing WTAL methods ignore the complementary relationship between modalities and the dependency between snippets, resulting in inaccurate localization results. To solve these issues, we propose a Collaborative Hierarchical Aggregation Network (CHA-Net). Specifically, we first use a modality complementary module to learn the synergies between modalities. Then, a collaborative enhance module is proposed to remove the information irrelevant to actions in RGB modality. Finally, a hierarchical aggregation module is proposed to capture the complete temporal information of action instances to better mine the temporal dependencies between snippets. Extensive experiments on THUMOS14, ActivityNet1.2, and ActivityNet1.3 datasets demonstrate the effectiveness of our method. Compared with F3-Net (TMM2024, Avg{0.1:0.5}) and SPCC-Net (TMM2024, Avg{0.1:0.7}) on the THUMOS14 dataset, the proposed method can achieve improvements of 3.2% and 2.4%, respectively.

Keywords:

Weakly Supervised Temporal Action Localization

Collaborative Enhance

Hierarchical Aggregation

A Collaborative Hierarchical Aggregation Network for Weakly Supervised Temporal Action Localization

Abstract

Journal

Organization