arrow
Return

Phase-Functioned Neural Networks for Character Control

delete2017-07-20
delete407
delete
OA
AI
D
Daniel Holden *
T
Taku Komura
J
Jun Saito
DOI:10.1145/3072959.3073663delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We present a real-time character control mechanism using a novel neural network architecture called a Phase-Functioned Neural Network. In this network structure, the weights are computed via a cyclic function which uses the phase as an input. Along with the phase, our system takes as input user controls, the previous state of the character, the geometry of the scene, and automatically produces high quality motions that achieve the desired user control. The entire network is trained in an end-to-end fashion on a large dataset composed of locomotion such as walking, running, jumping, and climbing movements fitted into virtual environments. Our system can therefore automatically produce motions where the character adapts to different geometric environments such as walking and running over rough terrain, climbing over large rocks, jumping over obstacles, and crouching under low ceilings. Our network architecture produces higher quality results than time-series autoregressive models such as LSTMs as it deals explicitly with the latent variable of motion relating to the phase. Once trained, our system is also extremely fast and compact, requiring only milliseconds of execution time and a few megabytes of memory, even when trained on gigabytes of motion data. Our work is most appropriate for controlling characters in interactive scenes such as computer games and virtual reality systems.
Keywords:
neural networks
locomotion
human motion
character animation
character control
deep learning

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.8K
Citations:
3.6W

Organization

U
University of Edinburgh
Scholars:
5.2W
Papers: 4.6W
Citations: 71
Cited Papers

Cited Papers

Synthesis of Constrained Walking Skills
err2008-12-01
err51
PREAI
errCoros, Stelian; Beaudoin, Philippe; Yin, KangKang; van de Panne, Michiel
errShare
errSave
errShare
errSave
errShare
errSave
errShare
errSave
Continuous Character Control with Low-Dimensional Embeddings
err2012-07-01
err143
PREAI
errLevine, Sergey; Wang, Jack M.; Haraux, Alexis; Popovic, Zoran; Koltun, Vladlen
errShare
errSave
Terrain-Adaptive Locomotion Skills Using Deep Reinforcement Learning
err2016-07-11
err163
PREAI
errBin Peng, Xue; Berseth, Glen; van de Panne, Michiel
errShare
errSave
Geometric Analysis of Alloreactive HLAα-Helices
err2014-01-01
err0
errOAAI
errReiner Ribarics; Rudolf Karch; Nevena Ilieva; Wolfgang Schreiner
errShare
errSave
Motion Reconstruction Using Sparse Accelerometer Data
err2011-05-19
err151
PREAI
errTautges, Jochen; Zinke, Arno; Krueger, Bjoern; Baumann, Jan; Weber, Andreas; Helten, Thomas; Mueller, Meinard; Seidel, Hans-Peter; Eberhardt, Bernd
errShare
errSave
errShare
errSave
researcher View more