.png){kind=icon}
返回
Imitation Learning-Based Algorithm for Drone Cinematography System
.png){kind=icon}
PRE
AI
DOI：10.1109/TCDS.2020.3043441.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Viewpoint selection for capturing human motion is an important task in autonomous aerial videography, animation, and virtual 3-D environments. Existing methods rely on heuristics for selecting the best viewpoint, which requires human effort to summarize and integrate viewpoint selection rules into a visual servo system to control a camera. In this work, we propose an integrated aerial filming system for autonomously capturing cinematic shots of action scenes on the basis of a set of demonstrations given for imitation. Our model, which is built on the basis of the deep deterministic policy gradient, takes a sequence of a subject's skeleton and the camera pose as input and outputs the camera motion with an optimal viewpoint related to the subject. In addition, we design a spatial attention network to selectively focus on the discriminative joints of the skeleton within each frame. Given the demonstrations with human motions, our framework learns to predict the next best viewpoint by imitating the demonstrations for viewing the motion of the subject. Extensive experimental results in simulated and real outdoor environments demonstrate that our method can successfully mimic the viewpoint selection strategy and capture a more accurate viewpoint than state-of-the-art autonomous cinematography methods.
Keyword:
Cameras
Skeleton
Drones
Visualization
Two dimensional displays
Cinematography
Encoding
Cinematography system
imitation filming
unmanned aerial vehicles
viewpoint control
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
4.9
论文数:
1.0K
被引数:
3.5K
机构
引用论文
.png){kind=icon}
A Novel Parsimonious Cause-Effect Reasoning Algorithm for Robot Imitation and Plan Recognition一种新的用于机器人模仿和计划识别的简约因果推理算法
PREAI
分享收藏分享收藏
查看更多内容