arrow
Return

Humans learn generalizable representations through efficient coding

delete2025-04-29
delete0
delete
OA
AI
Z
Zeming Fang *
C
Chris R. Sims
DOI:10.1038/s41467-025-58848-6delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Reinforcement learning theory explains human behavior as driven by the goal of maximizing reward. Conventional approaches, however, offer limited insights into how people generalize from past experiences to new situations. Here, we propose refining the classical reinforcement learning framework by incorporating an efficient coding principle, which emphasizes maximizing reward using the simplest necessary representations. This refined framework predicts that intelligent agents, constrained by simpler representations, will inevitably: 1) distill environmental stimuli into fewer, abstract internal states, and 2) detect and utilize rewarding environmental features. Consequently, complex stimuli are mapped to compact representations, forming the foundation for generalization. We tested this idea in two experiments that examined human generalization. Our findings reveal that while conventional models fall short in generalization, models incorporating efficient coding achieve human-level performance. We argue that the classical RL objective, augmented with efficient coding, represents a more comprehensive computational framework for understanding human behavior in both learning and generalization.
Keywords:
GANGLIA MEMORY-SYSTEMS
ACQUIRED EQUIVALENCE
NEURAL SIGNATURE
UNIVERSAL LAW
REINFORCEMENT
STATISTICS
PREDICTION
ATTENTION
KNOWLEDGE

Journal

Nature Communications cover
Nature Communications
IF:
15.7
Papers:
9.3W
Citations:
91.2W

Organization

No organization information available
Cited Papers

Cited Papers

Context, Learning, and Extinction
err2010-01-01
err278
PREAI
errGershman, Samuel J.; Blei, David M.; Niv, Yael
errShare
errSave
An information-theoretic perspective on the costs of cognition
err2019-02-01
err0
errOAAI
errAlexandre Zénon; Oleg Solopchuk; Giovanni Pezzulo
errShare
errSave
errShare
errSave
Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning
err2017-10-13
err0
errOAAI
errIan Ballard; Eric M Miller; Steven T Piantadosi; Noah D Goodman; Samuel M McClure
errShare
errSave
researcher View more