arrow
Return

Engineering a Less Artificial Intelligence

delete2019-09-01
delete109
PRE
AI
F
Fabian H. Sinz *
X
Xaq Pitkow
J
Jacob Reimer
M
Matthias Bethge
A
Andreas S. Tolias *
DOI:10.1016/j.neuron.2019.08.034delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Despite enormous progress in machine learning, artificial neural networks still lag behind brains in their ability to generalize to new situations. Given identical training data, differences in generalization are caused by many defining features of a learning algorithm, such as network architecture and learning rule. Their joint effect, called inductive bias,'' determines how well any learning algorithm-or brain-generalizes: robust generalization needs good inductive biases. Artificial networks use rather nonspecific biases and often latch onto patterns that are only informative about the statistics of the training data but may not generalize to different scenarios. Brains, on the other hand, generalize across comparatively drastic changes in the sensory input all the time. We highlight some shortcomings of state-of-the-art learning algorithms compared to biological brains and discuss several ideas about how neuroscience can guide the quest for better inductive biases by providing useful constraints on representations and network architecture.
Keywords:
DEEP LEARNING-MODELS
WHITE-NOISE ANALYSIS
HIERARCHICAL-MODELS
RECEPTIVE-FIELDS
VISUAL NEURONS
RESPONSES
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neuron cover
Neuron
IF:
15
Papers:
1.4W
Citations:
9.9W

Organization

E
eberhard karls university of tubingen
Scholars:
3.3W
Papers: 2.5W
Citations: 38
B
Baylor College of Medicine
Scholars:
4.1W
Papers: 3.0W
Citations: 4.2W
Cited Papers

Cited Papers

Neural Encoding of Rapidly Fluctuating Odors
errNEURON
IF15
err2009-02-01
err103
errOAAI
errGeffen, Maria N.; Broome, Bede M.; Laurent, Gilles; Meister, Markus
errShare
errSave
Genomic-sequence comparison of two unrelated isolates of the human gastric pathogen Helicobacter pylori
err1999-01-14
err0
PREAI
errRichard A. Alm; Lo-See L. Ling; Donald T. Moir; Benjamin L. King; Eric D. Brown; Peter C. Doig; Douglas R. Smith; Brian Noonan; Braydon C. Guild; Boudewijn L. deJonge; Gilles Carmel; Peter J. Tummino; Anthony Caruso; Maria Uria-Nickelsen; Debra M. Mills; Cameron Ives; Rene Gibson; David Merberg; Scott D. Mills; Qin Jiang; Diane E. Taylor; Gerald F. Vovis; Trevor J. Trust
errShare
errSave
How to Grow a Mind: Statistics, Structure, and Abstraction
errSCIENCE
IF45.8
err2011-03-11
err1.1K
PREAI
errTenenbaum, Joshua B.; Kemp, Charles; Griffiths, Thomas L.; Goodman, Noah D.
errShare
errSave
Feasibility of A Novel Web-Based Physical Activity Questionnaire for Young Children
err2012-12-06
err0
errOAAI
errStephanie E. Bonn; Pamela J. Surkan; Ylva Trolle Lagerros; Katarina Bälter
errShare
errSave
Timing of Estrus in Fallow Deer Is Adjusted to the Age of Available Mates
err1999-04-01
err0
PREAI
errPetr E. Komers; Björn Birgersson; Kenneth Ekvall
errShare
errSave
researcher View more