CTAA: Cross-Task Attention Alignment for temporal action detection

Tianwei Qu

doi:10.1007/s11227-026-08504-7

CTAA: Cross-Task Attention Alignment for temporal action detection

2026-04-22

0

PRE

AI

DOI：10.1007/s11227-026-08504-7

Original

Original request for help

Save

Abstract

En 中文

Temporal action detection aims to classify and locate the actions in the video. However, the existing methods adopt a unified feature processing paradigm for the characteristics of the two sub-tasks, ignoring the mutual influence between two sub-tasks, which leads to a degradation in the performance of temporal action detection. To address this problem, we propose a Cross-Task Attention Alignment (CTAA) technique, which enhances the detection performance by specifically differentiating and refines the classification features and regression features. Specifically, in order to achieve effective separation and adaptive interaction between classification features and regression features, we design a novel Cross-task Refinement Module (CRM). CRM utilizes the attention mechanism to capture the intra-task feature correlations within each specific task and the cross-task connections between different tasks, thereby achieving fine feature separation. Subsequently, we further propose a Cross-channel Interaction Module (CIM), which integrates Mamba and Cross-channel Attention Fusion (CAF). It uses Mamba to capture the long-range temporal dependencies within each sub-channel, while our proposed CAF is designed to mine the fine-grained information within individual sub-channels and promote effective information exchange between sub-channels and the global channels. We conduct extensive experiments to validate our CTAA on four challenging datasets, i.e., THUMOS14, ActivityNet-1.3, MultiTHUMOS, and EPIC-Kitchens 100.

Keywords:

Cross-task attention

Temporal action detection

Cross-channel interaction

Cross-channel attention

CTAA: Cross-Task Attention Alignment for temporal action detection

Abstract

Journal

Organization