arrow
返回

Learning perceptually grounded word meanings from unaligned parallel data

delete2013-05-18
delete29
PRE
AI
S
Stefanie Tellex *
P
Pratiksha Thaker
J
Joshua Joseph
N
Nicholas Roy
DOI:10.1007/s10994-013-5383-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In order for robots to effectively understand natural language commands, they must be able to acquire meaning representations that can be mapped to perceptual features in the external world. Previous approaches to learning these grounded meaning representations require detailed annotations at training time. In this paper, we present an approach to grounded language acquisition which is capable of jointly learning a policy for following natural language commands such as Pick up the tire pallet, as well as a mapping between specific phrases in the language and aspects of the external world; for example the mapping between the words the tire pallet and a specific object in the environment. Our approach assumes a parametric form for the policy that the robot uses to choose actions in response to a natural language command that factors based on the structure of the language. We use a gradient method to optimize model parameters. Our evaluation demonstrates the effectiveness of the model on a corpus of commands given to a robotic forklift by untrained users.
Keyword:
Robotics
Language
Machine learning
Probabilistic graphical models

期刊

Machine Learning 封面图
Machine Learning
IF:
2.9
论文数:
2.7K
被引数:
3.4W

机构

暂无机构信息
引用论文

引用论文

Development of low-background vacuum extraction and graphitization systems for 14C dating of old (40–60 ka) samples
err2007-05-01
err0
PREAI
errJeffrey S. Pigati; Jay Quade; Jim Wilson; A.J. Timothy Jull; Nathaniel A. Lifton
err分享
err收藏
Growth Characteristics of a Small-fruit Dwarf Mutant Arising from Bud Sport Mutation in Japanese Persimmon (Diospyros kaki Thunb.)
err2008-10-01
err0
errOAAI
errHisayo Yamane; Megumi Ichiki; Ryutaro Tao; Tomoya Esumi; Keizo Yonemori; Takeshi Niikawa; Hino Motosugi
err分享
err收藏
Structure of Stable Protein Folding Intermediates by Equilibrium ϕ-Analysis: The Apoflavodoxin Thermal Intermediate
err2004-11-01
err0
PREAI
errLuis A. Campos; Marta Bueno; Jon Lopez-Llano; María Ángeles Jiménez; Javier Sancho
err分享
err收藏
Object schemas for grounding language in a responsive robot
err2008-11-21
err19
errOAAI
errHsiao, Kai-yuh; Tellex, Stefanie; Vosoughi, Soroush; Kubat, Rony; Roy, Deb
err分享
err收藏
err分享
err收藏
Pharmacological Modulation of the Late Eosinophilia Induced by Antigen in Actively Sensitized Rats
err2009-09-02
err0
PREAI
errPatricia M.R. e Silva; Marco A. Martins; Marcia C.R. Lima; Alessandra C. Alves; Bruno L. Diaz; Renato S.B. Cordeiro
err分享
err收藏
没有更多内容