.png){kind=icon}
.png){kind=icon}
Return
Hippocampus supports multi-task reinforcement learning under partial observability
.png){kind=icon}
OA
AI
DOI：10.1038/s41467-025-64591-9.png)
.png){kind=icon}
.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Mastering navigation in environments with limited visibility is crucial for survival. Although the hippocampus has been associated with goal-oriented navigation, its role in real-world behaviour remains unclear. To investigate this, we combined deep reinforcement learning (RL) modelling with behavioural and neural data analysis. First, we trained RL agents in partially observable environments using egocentric and allocentric tasks. We show that agents equipped with recurrent hippocampal circuitry, but not purely feedforward networks, learned the tasks in line with animal behaviour. Next, we used dimensionality reduction of the agents’ internal representations to extract components reflecting reward, strategy, and temporal representations, which we validated experimentally against hippocampal recordings from rats. Moreover, hippocampal RL agents predicted state-specific trajectories, mirroring empirical findings. In contrast, agents trained in fully observable environments failed to capture experimental observations. Finally, we show that hippocampal-like RL agents demonstrated improved generalisation across novel task conditions. In summary, our findings suggest an important role of hippocampal networks in facilitating reinforcement learning in naturalistic environments. Neural mechanisms underlying reinforcement learning in naturalistic environments are not fully understood. Here authors show that reinforcement learning (RL) agents with hippocampal-like recurrence, unlike feedforward networks, match animal behaviour and neural data in navigation tasks, revealing that hippocampal circuits support RL in naturalistic environments.
Keywords:
Hippocampus
Reinforcement learning
Partial observability
Navigation
Neural mechanisms
AI Summary
Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.
Journal
IF:
15.7
Papers:
9.3W
Citations:
91.2W