arrow
返回

Hybrid computing using a neural network with dynamic external memory

delete2016-10-12
delete1.0K
PRE
AI
A
Alex Graves
G
Greg Wayne
M
Malcolm Reynolds
T
Tim Harley
I
Ivo Danihelka
A
Agnieszka Grabska‐Barwińska
S
Sergio Gómez Colmenarejo
E
Edward Grefenstette
T
Tiago Ramalho
J
John Agapiou
A
Adrià Puigdomènech Badia
K
Karl Moritz Hermann
Y
Yori Zwólš
G
Georg Ostrovski
A
Adam Cain
H
Helen King
C
Christopher Summerfield
P
Phil Blunsom
K
Koray Kavukcuoglu
D
Demis Hassabis *
DOI:10.1038/nature20101delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Artificial neural networks are remarkably adept at sensory processing, sequence learning and reinforcement learning, but are limited in their ability to represent variables and data structures and to store data over long timescales, owing to the lack of an external memory. Here we introduce a machine learning model called a differentiable neural computer (DNC), which consists of a neural network that can read from and write to an external memory matrix, analogous to the random-access memory in a conventional computer. Like a conventional computer, it can use its memory to represent and manipulate complex data structures, but, like a neural network, it can learn to do so from data. When trained with supervised learning, we demonstrate that a DNC can successfully answer synthetic questions designed to emulate reasoning and inference problems in natural language. We show that it can learn tasks such as finding the shortest path between specified points and inferring the missing links in randomly generated graphs, and then generalize these tasks to specific graphs such as transport networks and family trees. When trained with reinforcement learning, a DNC can complete a moving blocks puzzle in which changing goals are specified by sequences of symbols. Taken together, our results demonstrate that DNCs have the capacity to solve complex, structured tasks that are inaccessible to neural networks without external read-write memory.
Keyword:
COMPLEMENTARY LEARNING-SYSTEMS
HIPPOCAMPUS
MODELS
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Nature 封面图
Nature
IF:
48.5
论文数:
1.8W
被引数:
96.5W

机构

G
Google Incorporated
学者数:
3.5K
论文数: 1.8K
被引数: 8
引用论文

引用论文

err分享
err收藏
The role of context in object recognition
err2007-12-01
err751
PREAI
errOliva, Aude; Torralba, Antonio
err分享
err收藏
A coupled thermosphere/ionosphere general circulation model
err2012-12-07
err0
PREAI
errR. G. Roble; E. C. Ridley; A. D. Richmond; R. E. Dickinson
err分享
err收藏
学者 查看更多内容