arrow
返回

Extremely Lightweight Skeleton-Based Action Recognition With ShiftGCN plus

delete2021-01-01
delete37
PRE
AI
K
Ke Cheng
张一帆 (Yifan Zhang) *
X
Xiangyu He
J
Jian Cheng
卢汉清 (Hanqing Lu)
DOI:10.1109/TIP.2021.3104182delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In skeleton-based action recognition, graph convolutional networks (GCNs) have achieved remarkable success. However, there are two shortcomings of current GCN-based methods. Firstly, the computation cost is pretty heavy, typically over 15 GFLOPs for one action sample. Some recent works even reach similar to 100 GFLOPs. Secondly, the receptive fields of both spatial graph and temporal graph are inflexible. Although recent works introduce incremental adaptive modules to enhance the expressiveness of spatial graph, their efficiency is still limited by regular GCN structures. In this paper, we propose a shift graph convolutional network (ShiftGCN) to overcome both short-comings. ShiftGCN is composed of novel shift graph operations and lightweight point-wise convolutions, where the shift graph operations provide flexible receptive fields for both spatial graph and temporal graph. To further boost the efficiency, we introduce four techniques and build a more lightweight skeleton-based action recognition model named ShiftGCN++. ShiftGCN-H- is an extremely computation-efficient model, which is designed for low-power and low-cost devices with very limited computing power. On three datasets for skeleton-based action recognition, ShiftGCN notably exceeds the state-of-the-art methods with over 10x less FLOPs and 4x practical speedup. ShiftGCN-H- further boosts the efficiency of ShiftGCN, which achieves comparable performance with 6x less FLOPs and 2x practical speedup.
Keyword:
Skeleton-based action recognition
graph convolutional network
lightweight network
shift network
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

C
chinese academy of sciences
学者数:
56.7W
论文数: 45.0W
被引数: 704
引用论文

引用论文

Evaluation of the Effect of Systolic Blood Pressure and Pulse Pressure on Cognitive Function: The Women's Health and Aging Study II
err2011-12-09
err0
errOAAI
errSevil Yasar; Jean Y. Ko; Stephanie Nothelle; Michelle M. Mielke; Michelle C. Carlson
err分享
err收藏
The mental health of staff working in intensive care during COVID-19
err
IF0
err2020-11-04
err0
errOAAI
errNeil Greenberg; Dale Weston; Charlotte Hall; Tristan Caulfield; Victoria Williamson; Kevin Fong
err分享
err收藏
Decomposition of RNA methylome reveals co-methylation patterns induced by latent enzymatic regulators of the epitranscriptome
err2015-01-01
err0
errOAAI
errLian Liu; Shao-Wu Zhang; Yu-Chen Zhang; Hui Liu; Lin Zhang; Runsheng Chen; Yufei Huang; Jia Meng
err分享
err收藏
err分享
err收藏
Skeleton-Based Human Action Recognition With Global Context-Aware Attention LSTM Networks
err2018-04-01
err423
errOAAI
errLiu, Jun; Wang, Gang; Duan, Ling-Yu; Abdiyeva, Kamila; Kot, Alex C.
err分享
err收藏
Organic acids can crosslink poly(ionic liquid)s into mesoporous polyelectrolyte complexes
err2013-01-01
err0
errOAAI
errQiang Zhao; Sebastian Soll; Markus Antonietti; Jiayin Yuan
err分享
err收藏
学者 查看更多内容