arrow
Return

Skip-attention encoder-decoder framework for human motion prediction

delete2021-06-11
delete10
PRE
AI
R
Ruipeng Zhang
X
Xiangbo Shu *
R
Rui Yan
J
Jiachao Zhang
Y
Yan Song
DOI:10.1007/s00530-021-00807-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Human motion prediction aims to automatically predict the future motion sequence based on an observed human motion sequence. In this paper, we propose a novel skip-attention encoder-decoder (SAED) framework to model human motion dependences in spatiotemporal space, by utilizing the encoder and decoder to encode the observed motions, and decode the predicted motions, respectively. Overall, this framework has two main insights. First, we design a new self-renewing ConvGRU as the unit of encoder and decoder to effectively capture temporal and spatial skeleton-motion dependencies. Second, we present a new skip-attention mechanism (SAM) to aggregate the motion information of all layers based on their importance. In experiments, quantitative and qualitative results on the Human3.6M and CMU motion capture datasets show the effectiveness of the proposed SAED compared with the related methods.
Keywords:
Encoder-decoder
Human motion prediction
Skip attention
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Multimedia Systems cover
Multimedia Systems
IF:
3.1
Papers:
2.8K
Citations:
2.7K

Organization

N
Nanjing Institute of Technology
Scholars:
2.4K
Papers: 2.2K
Citations: 2.5K
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
A facile electrochemical sensor based on a composite of electrochemically reduced graphene oxide and a PEDOT:PSS modified glassy carbon electrode for uric acid detection
err2022-02-28
err0
errOAAI
errBudi R. Putra; Ulfiatun Nisa; Rudi Heryanto; Eti Rohaeti; Munawar Khalil; Arini Izzataddini; Wulan T. Wahyuni
errShare
errSave
SINE: Scalable Incomplete Network Embedding
err2018-11-01
err0
errOAAI
errDaokun Zhang; Jie Yin; Xingquan Zhu; Chengqi Zhang
errShare
errSave
errShare
errSave
Multiple paternity does not depend on male genetic diversity
err2014-07-01
err0
errOAAI
errKerstin E. Thonhauser; Shirley Raveh; Dustin J. Penn
errShare
errSave
Structural study of lanthanides(III) in aqueous nitrate and chloride solutions by EXAFS
err1999-02-01
err0
PREAI
errT. Yaita; H. Narita; Sh. Suzuki; Sh. Tachimori; H. Motohashi; H. Shiwaku
errShare
errSave
errShare
errSave
researcher View more