arrow
返回

Skeleton-Based Action Segmentation With Multi-Stage Spatial-Temporal Graph Convolutional Neural Networks

delete2024-01-01
delete16
delete
OA
AI
B
Benjamin Filtjens *
B
Bart Vanrumste
P
Peter Slaets
DOI:10.1109/TETC.2022.3230912delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The ability to identify and temporally segment fine-grained actions in motion capture sequences is crucial for applications in human movement analysis. Motion capture is typically performed with optical or inertial measurement systems, which encode human movement as a time series of human joint locations and orientations or their higher-order representations. State-of-the-art action segmentation approaches use multiple stages of temporal convolutions. The main idea is to generate an initial prediction with several layers of temporal convolutions and refine these predictions over multiple stages, also with temporal convolutions. Although these approaches capture long-term temporal patterns, the initial predictions do not adequately consider the spatial hierarchy among the human joints. To address this limitation, we recently introduced multi-stage spatial-temporal graph convolutional neural networks (MS-GCN). Our framework replaces the initial stage of temporal convolutions with spatial graph convolutions and dilated temporal convolutions, which better exploit the spatial configuration of the joints and their long-term temporal dynamics. Our framework was compared to four strong baselines on five tasks. Experimental results demonstrate that our framework is a strong baseline for skeleton-based action segmentation.
Keyword:
Activity segmentation
activity detection
dense labelling
freezing of gait
graph convolutional
MS-GCN
multi-stage
spatial-temporal

期刊

IEEE Transactions on Emerging Topics in Computing 封面图
IEEE Transactions on Emerging Topics in Computing
IF:
5.4
论文数:
1.1K
被引数:
3.4K

机构

K
KU Leuven
学者数:
5.7W
论文数: 5.2W
被引数: 8.1W
引用论文

引用论文

Dual-task effects of talking while walking on velocity and balance following a stroke
err2001-07-01
err174
errOAAI
errBowen, A; Wenman, R; Mickelborough, J; Foster, J; Hill, E; Tallis, R
err分享
err收藏
Minimal residual disease and imaging‐guided consolidation strategies in newly diagnosed and relapsed refractory multiple myeloma新诊断和复发难治性多发性骨髓瘤的最小残留病和影像学指导的巩固策略
err2022-05-18
err0
errOAAI
errDavid Böckle; Paula Tabares; Xiang Zhou; Sven Schimanski; Maximilian J. Steinhardt; Max Bittrich; Elena Seebacher; Maria Ulbrich; Amy Wilnit; Corona Metz; Anke Heidemeier; Thorsten Bley; Rudolf Werner; Andreas Buck; Hermann Einsele; K. Martin Kortüm; Andreas Beilhack; Leo Rasche
err分享
err收藏
Efficient dense labelling of human activity sequences from wearables using fully convolutional networks
err2018-06-01
err76
PREAI
errYao, Rui; Lin, Guosheng; Shi, Qinfeng; Ranasinghe, Damith C.
err分享
err收藏
Freezing of Gait in Parkinson's Disease: The Impact of Dual-Tasking and Turning
err2010-11-10
err288
PREAI
errSpildooren, Joke; Vercruysse, Sarah; Desloovere, Kaat; Vandenberghe, Wim; Kerckhofs, Eric; Nieuwboer, Alice
err分享
err收藏
Contrasting fungal responses to wildfire across different ecosystem types
err2020-12-15
err0
PREAI
errGabriel Reuben Smith; Lucy C. Edy; Kabir G. Peay
err分享
err收藏
学者 查看更多内容