.png){kind=icon}
Return
Temporal refinement network: Combining dynamic convolution and multi-scale information for fine-grained action recognition
.png){kind=icon}
PRE
AI
DOI：10.1016/j.imavis.2024.105058.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Fine-grained action recognition is challenging due to the nearly identical context, limited background information, and less distinct inter-class differences compared to coarse-grained actions.Effectively capturing spatiotemporal information is crucial for fine-grained action recognition models. To address the limitations of coarsegrained models in describing spatio-temporal context, we propose a Temporal Refinement Block (TRB) as an efficient component for fine-grained action recognition. The TRB enables our model to effectively model underlying semantics and global dependencies by generating spatial-temporal kernels of different scales and performing fully connected operations within the temporal dimension. Our experiments demonstrate the effectiveness of TRB in learning latent semantics and global dependencies. To further enhance the framework's performance, we incorporate an enhanced spatio-temporal pyramidal network (TPN) that collects beat information and utilizes dilated convolutions to boost multi-scale features.We refer to the proposed framework as the Temporal Refinement Network, abbreviated as TRN.Our TRN achieves competitive performance on the FineGym and Diving48 benchmarks.
Keywords:
Fine-grained action recognition
Temporal refinement block
Temporal pyramidal network
Journal
IF:
4.2
Papers:
4.1K
Citations:
6.7K
Organization
.png){kind=icon}
