arrow
返回

Embodied scene description

delete2021-10-21
delete6
PRE
AI
S
Sinan Tan
D
Di Guo
刘华坪 封面图
刘华坪 (Huaping Liu) *
X
Xinyu Zhang
孙富春 封面图
孙富春 (Fuchun Sun)
DOI:10.1007/s10514-021-10014-9delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Embodiment is an important characteristic for all intelligent agents, while existing scene description tasks mainly focus on analyzing images passively and the semantic understanding of the scenario is separated from the interaction between the agent and the environment. In this work, we propose the Embodied Scene Description, which exploits the embodiment ability of the agent to find an optimal viewpoint in its environment for scene description tasks. A learning framework with the paradigms of imitation learning and reinforcement learning is established to teach the intelligent agent to generate corresponding sensorimotor activities. The proposed framework is tested on both the AI2Thor dataset and a real-world robotic platform for different scene description tasks, demonstrating the effectiveness and scalability of the developed method. Also, a mobile application is developed, which can be used to assist visually-impaired people to better understand their surroundings.
Keyword:
Embodied perception
Embodied learning
Scene description
Environment exploration
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Autonomous Robots 封面图
Autonomous Robots
IF:
4.3
论文数:
1.7K
被引数:
5.0K

机构

T
tsinghua university
学者数:
11.9W
论文数: 10.0W
被引数: 137
引用论文

引用论文

err
IF0
err
err0
PREAI
err
err分享
err收藏
err分享
err收藏
Continuous Finger Kinematics Estimation Based on sEMG and Attention-ConvGRU Network
err2022-08-10
err0
PREAI
errPenghui Zhao; Chuang Lin; Jianhua Zhang; Xinyue Niu; Yanhong Liu
err分享
err收藏
学者 查看更多内容