.png){kind=icon}
返回
Memory Attention Networks for Skeleton-Based Action Recognition
.png){kind=icon}
OA
AI
DOI：10.1109/TNNLS.2021.3061115.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Skeleton-based action recognition has been extensively studied, but it remains an unsolved problem because of the complex variations of skeleton joints in 3-D spatiotemporal space. To handle this issue, we propose a newly temporal-then-spatial recalibration method named memory attention networks (MANs) and deploy MANs using the temporal attention recalibration module (TARM) and spatiotemporal convolution module (STCM). In the TARM, a novel temporal attention mechanism is built based on residual learning to recalibrate frames of skeleton data temporally. In the STCM, the recalibrated sequence is transformed or encoded as the input of CNNs to further model the spatiotemporal information of skeleton sequence. Based on MANs, a new collaborative memory fusion module (CMFM) is proposed to further improve the efficiency, leading to the collaborative MANs (C-MANs), trained with two streams of base MANs. TARM, STCM, and CMFM form a single network seamlessly and enable the whole network to be trained in an end-to-end fashion. Comparing with the state-of-the-art methods, MANs and C-MANs improve the performance significantly and achieve the best results on six data sets for action recognition. The source code has been made publicly available at https://github.com/memory-attention-networks.
Keyword:
Skeleton
Spatiotemporal phenomena
Convolution
Feature extraction
Computer architecture
Collaboration
Learning systems
Collaborative memory fusion module (CMFM)
memory attention networks (MANs)
skeleton-based action recognition
spatiotemporal convolution module (STCM)
temporal attention recalibration module
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
8.9
论文数:
7.6K
被引数:
7.2W
机构
引用论文
分享收藏分享收藏Fission Yeast Sec3 and Exo70 Are Transported on Actin Cables and Localize the Exocyst Complex to Cell Poles.png)
PLoS ONEOAAI
PLoS ONEIF0
OAAI分享收藏MAP1a associated light chain 3 increases microtubule stability by suppressing microtubule dynamics
PREAI
分享收藏Enhanced skeleton visualization for view invariant human action recognition用于视图不变人体动作识别的增强骨架可视化PATTERN RECOGNITION
PATTERN RECOGNITIONIF7.6
PREAI
分享收藏
查看更多内容