arrow
Return

Skip-attention encoder-decoder framework for human motion prediction

delete2021-06-11
delete10
PRE
AI
R
Ruipeng Zhang
X
Xiangbo Shu *
R
Rui Yan
J
Jiachao Zhang
Y
Yan Song
DOI:10.1007/s00530-021-00807-4delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Human motion prediction aims to automatically predict the future motion sequence based on an observed human motion sequence. In this paper, we propose a novel skip-attention encoder-decoder (SAED) framework to model human motion dependences in spatiotemporal space, by utilizing the encoder and decoder to encode the observed motions, and decode the predicted motions, respectively. Overall, this framework has two main insights. First, we design a new self-renewing ConvGRU as the unit of encoder and decoder to effectively capture temporal and spatial skeleton-motion dependencies. Second, we present a new skip-attention mechanism (SAM) to aggregate the motion information of all layers based on their importance. In experiments, quantitative and qualitative results on the Human3.6M and CMU motion capture datasets show the effectiveness of the proposed SAED compared with the related methods.
Keywords:
Encoder-decoder
Human motion prediction
Skip attention
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Multimedia Systems cover
Multimedia Systems
IF:
3.1
Papers:
2.7K
Citations:
2.7K

Organization

N
Nanjing Institute of Technology
Scholars:
2.4K
Papers: 2.2K
Citations: 2.5K