arrow
Return

Data-driven ANN-based visual decoding enables unsupervised functional alignment

delete2026-01-08
delete0
delete
OA
AI
X
Xin-Ya Zhang *
H
Hang Lin
Z
Zeyu Deng
M
Markus Siegel
E
E. K. Miller
G
Gang Yan
DOI:10.1038/s42003-025-09486-7delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Artificial neural networks (ANNs) offer a data-driven approach to reveal brain regional functions without explicit supervision. Here, we demonstrate that an ANN trained to decode visual stimuli from multi-unit spiking activity in monkeys, can not only reconstruct complex and dynamic scenes, but also spontaneously align with canonical cortical visual functions. Without any region-specific functional priors, the model identifies key brain areas associated with shape, color, and motion processing. We provide strong evidence that, despite low train-test dataset correlation at the recording-site level, the ANN-based model is able to learn task-relevant representations embedded at a high-dimensional population level and achieve reliable decoding performance. Furthermore, by inverting the architecture and retraining, we show that the same network can predict region-specific spiking patterns from visual input, indicating a reciprocal relationship between encoding and decoding. These findings shed light on ANN-based visual decoding as a powerful framework for unsupervised functional alignment in neural systems. A data-driven artificial neural network model decodes dynamic visual stimuli from monkey multi-unit spiking activity, reconstructing shapes, colors, and motion with high fidelity. It spontaneously aligns with canonical cortical visual functions without region priors, and its inverse architecture predicts neural spiking from visuals, revealing reciprocal encoding-decoding in neural systems.
Keywords:
Artificial neural networks
Visual decoding
Functional alignment
Cortical processing
Spiking activity
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Communications Biology cover
Communications Biology
IF:
5.1
Papers:
1.0W
Citations:
3.2W

Organization

W
Westlake University
Scholars:
1.9K
Papers: 724
Citations: 8.9K
T
Tongji University
Scholars:
5.2K
Papers: 2.1K
Citations: 388
U
university of tubingen
Scholars:
509
Papers: 188
Citations: 0
S
Southern Methodist University
Scholars:
3.0K
Papers: 3.5K
Citations: 3.9K
M
massachusetts institute of technology
Scholars:
4.1K
Papers: 1.5K
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

A deep learning framework for neuroscience
err2019-10-28
err0
errOAAI
errBlake A. Richards; Timothy P. Lillicrap; Philippe Beaudoin; Yoshua Bengio; Rafal Bogacz; Amelia Christensen; Claudia Clopath; Rui Ponte Costa; Archy de Berker; Surya Ganguli; Colleen J. Gillon; Danijar Hafner; Adam Kepecs; Nikolaus Kriegeskorte; Peter Latham; Grace W. Lindsay; Kenneth D. Miller; Richard Naud; Christopher C. Pack; Panayiota Poirazi; Pieter Roelfsema; João Sacramento; Andrew Saxe; Benjamin Scellier; Anna C. Schapiro; Walter Senn; Greg Wayne; Daniel Yamins; Friedemann Zenke; Joel Zylberberg; Denis Therien; Konrad P. Kording
errShare
errSave
Cortical information flow during flexible sensorimotor decisions
err2015-06-19
err0
errOAAI
errMarkus Siegel; Timothy J. Buschman; Earl K. Miller
errShare
errSave
errShare
errSave
errShare
errSave
Visual cortex encodes timing information in humans and mice
errNEURON
IF15
err2022-12-01
err5
PREAI
errYu, Qingpeng; Bi, Zedong; Jiang, Shize; Yan, Biao; Chen, Heming; Wang, Yiting; Miao, Yizhan; Li, Kexin; Wei, Zixuan; Xie, Yuanting; Tan, Xinrong; Liu, Xiaodi; Fu, Hang; Cui, Liyuan; Xing, Lu; Weng, Shijun; Wang, Xin; Yuan, Yuanzhi; Zhou, Changsong; Wang, Gang; Li, Liang; Ma, Lan; Mao, Ying; Chen, Liang; Zhang, Jiayi
errShare
errSave
The imperative of interpretable machines
err2020-04-13
err20
PREAI
errStoyanovich, Julia; Van Bavel, Jay J.; West, Tessa V.
errShare
errSave
researcher View more