arrow
Return

A CRNN-based attention-seq2seq model with fusion feature for automatic Labanotation generation1

delete2021-09-01
delete20
PRE
AI
M
Min Li
Z
Zhenjiang Miao *
W
Wanru Xu
DOI:10.1016/j.neucom.2021.05.036delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Labanotation is a widely-used notation system for dance recording. Numerous methods for automatic Labanotation generation from motion capture data have been proposed to save time and human labor. However, dance performance variations, data noises, and difficulties in recognizing long continuous motion sequences limit the performance of existed methods. In this paper, we propose a CRNN-based attention-seq2seq model with fusion features for a robust and effective Labanotation generation.First, we fuse bone feature and Lie group feature to extract not only the information of bones between adjacent joints but also the relative geometry relationships between connected bones. Then, in the proposed seq2seq model, we employ the Convolutional Recurrent Neural Networks (CRNN) to learn the spatial-temporal representation of motion capture data and the attention mechanism to learn good alignments between input motion feature sequences and output symbol sequences. Extensive experiments on real-world datasets show that the proposed method obtains considerable recognition accuracy (90.65% on the LabanSeq16 dataset and 93.29% on the LabanSeq48 dataset), which outperforms state-of-the-art approaches on the task of automatic Labanotation generation. (c) 2021 Elsevier B.V. All rights reserved.
Keywords:
Labanotation generation
CRNN
Attention-seq2seq
Fusion feature
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neurocomputing cover
Neurocomputing
IF:
6.5
Papers:
2.5W
Citations:
6.5W

Organization

B
Beijing Jiaotong University
Scholars:
2.2W
Papers: 1.7W
Citations: 1.2W