arrow
Return

Brain-inspired spatial intelligence for embodied agents

delete2026-06-27
delete0
delete
OA
AI
S
Shouwei Ruan
L
Liyuan Wang
C
Caixin Kang
Q
Qihui Zhu
S
Songming Liu
X
Xingxing Wei *
H
Hang Su *
DOI:10.1038/s41467-026-74358-5delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Spatial cognition enables adaptive goal-directed behavior through structured internal models of space. Robust biological systems consolidate spatial knowledge into three interconnected forms: landmarks for salient cues, route knowledge for movement trajectories, and survey knowledge for map-like representations. While recent advances in multi-modal large language models (MLLMs) have enabled visual-language reasoning in embodied agents, these efforts lack structured spatial memory and instead operate reactively, limiting their generalization and adaptability in complex real-world environments. Here we present Brain-inspired Spatial Cognition for Navigation (BSC-Nav), a unified framework for constructing and leveraging structured spatial memory in embodied agents. BSC-Nav builds allocentric cognitive maps from egocentric trajectories and contextual cues, and dynamically retrieves spatial knowledge aligned with semantic goals. Integrated with powerful MLLMs, BSC-Nav achieves state-of-the-art efficacy and efficiency across diverse embodied navigation tasks (e.g., improving success weighted by path length from 17.6% to 44.9% in instance-level navigation and from 42.7% to 53.1% in zero-shot long-horizon instruction-following), while also supporting versatile embodied behaviors in the real physical world. These results highlight a scalable path toward general-purpose spatial intelligence. Integrating biological spatial memory into artificial embodied agents remains an open challenge. Here, the authors develop BSC-Nav, a brain-inspired spatial cognition framework, demonstrating enhanced navigation and general-purpose spatial intelligence.
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Nature Communications cover
Nature Communications
IF:
15.7
Papers:
9.4W
Citations:
91.2W

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
T
tsinghua university
Scholars:
11.9W
Papers: 10.0W
Citations: 137
Cited Papers

Cited Papers

No cited papers available