1
Return

Three-Dimensional Object Perception Can Emerge From Predictive Learning

delete2026-06-04
delete0
delete
OA
AI
J
John Day
T
Tushar Arora
J
Jirui Liu
L
Li Erran Li
M
Ming Bo Cai *
DOI:10.1111/desc.70218delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
How do infants develop the ability to perceive objects in a 3D world? The theory of core knowledge suggests infants employ a few principles, such as cohesion, continuity, rigidity, and contact, to guide inference of objects. However, it is challenging to answer how object perception can be learned with similar constraints faced by infants and whether these principles are sufficient for the learning, solely based on studies of infant behavior. We hypothesize that the construct of objects emerges to serve the purpose of efficient prediction, and tested the computational sufficiency of these principles with a deep neural network model trained in a simplified virtual environment that mimics key constraints faced by the infant brain with an objective of learning to predict future visual input. The model simultaneously learns three fundamental perceptual capabilities without supervision: depth perception, object segmentation, and 3D localization of objects from single images. Its internal representation of objects reflects their shapes and textures. Of the core knowledge principles, the cohesion, continuity, and rigidity principles are a sufficient subset that allows our model to learn object perception in the environment tested, without incorporating the contact principle. Relaxing the assumption of rigidity harms depth perception and 3D localization of objects, but preserves 2D object segmentation. Our findings suggest that predictive learning is a potential candidate mechanism that drives the emergence of object perception in early development.
Keywords:
3D perception
core knowledge
infant development
object perception
predictive learning
unsupervised learning

Journal

Developmental Science cover
Developmental Science
IF:
3.2
Papers:
2.9K
Citations:
9.5K

Organization

B
boston university
Scholars:
3.7W
Papers: 3.2W
Citations: 67
T
tsinghua university
Scholars:
11.5W
Papers: 9.9W
Citations: 137
U
university of tokyo
Scholars:
5.4K
Papers: 2.2K
Citations: 0
U
university of miami
Scholars:
3.3W
Papers: 2.5W
Citations: 32
A
amazon.com inc.
Scholars:
2
Papers: 2
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers