arrow
Return

The Eighty Five Percent Rule for optimal learning

delete2019-11-05
delete54
delete
OA
AI
R
Robert C. Wilson *
A
Amitai Shenhav
M
Mark A. Straccia
J
Jonathan D. Cohen
DOI:10.1038/s41467-019-12552-4delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Researchers and educators have long wrestled with the question of how best to teach their clients be they humans, non-human animals or machines. Here, we examine the role of a single variable, the difficulty of training, on the rate of learning. In many situations we find that there is a sweet spot in which training is neither too easy nor too hard, and where learning progresses most quickly. We derive conditions for this sweet spot for a broad class of learning algorithms in the context of binary classification tasks. For all of these stochastic gradient-descent based learning algorithms, we find that the optimal error rate for training is around 15.87% or, conversely, that the optimal training accuracy is about 85%. We demonstrate the efficacy of this 'Eighty Five Percent Rule' for artificial neural networks used in AI and biologically plausible neural networks thought to describe animal learning.
Keywords:
ACCOUNT
MOTION
MODEL
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Communications cover
Nature Communications
IF:
15.7
Papers:
9.2W
Citations:
91.2W

Organization

B
Brown University
Scholars:
2.4W
Papers: 2.2W
Citations: 3.2W
U
university of california los angeles
Scholars:
5.3W
Papers: 4.2W
Citations: 89
U
University of Arizona
Scholars:
3.6W
Papers: 3.2W
Citations: 980
University of California System cover
University of California System
Scholars:
37.5W
Papers: 33.7W
Citations: 6.6K
researcher View more organizations