.png){kind=icon}
返回
TSRN: two-stage refinement network for temporal action segmentation
.png){kind=icon}
PRE
AI
DOI：10.1007/s10044-023-01166-8.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In high-level video semantic understanding, continuous action segmentation is a challenging task aimed at segmenting an untrimmed video and labeling each segment with predefined labels over time. However, the accuracy of segment predictions is limited by confusing information in video sequences, such as ambiguous frames during action boundaries or over-segmentation errors due to the lack of semantic relations. In this work, we present a two-stage refinement network (TSRN) to improve temporal action segmentation. We first capture global relations over an entire video sequence using a multi-head self-attention mechanism in the novel transformer temporal convolutional network and model temporal relations in each action segment. Then, we introduce a dual-attention spatial pyramid pooling network to fuse features from macro-scale and microscale perspectives, providing more accurate classification results from the initial prediction. In addition, a joint loss function mitigates over-segmentation. Compared with state-of-the-art methods, the proposed TSRN substantially improves temporal action segmentation on three challenging datasets (i.e., 50Salads, Georgia Tech Egocentric Activities, and Breakfast).
Keyword:
Temporal action segmentation
Video semantic understanding
Refinement network
Self-attention
Over-segmentation
期刊
IF:
2
论文数:
2.0K
被引数:
1.9K
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
PREAI
分享收藏
Digital image forensic approach based on the second-order statistical analysis of CFA artifacts
PREAI
分享收藏Comparative study of layer by layer assembled multilayer films based on graphene oxide and reduced graphene oxide on flexible polyurethane foam: flame retardant and smoke suppression properties.png)
RSC Advances
RSC AdvancesIF0
PREAI
分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现Indoor Air
OAAI
Indoor AirIF0
OAAI分享收藏
查看更多内容