arrow
Return

Inter-individual and inter-site neural code conversion without shared stimuli

delete2025-07-11
delete0
delete
OA
AI
H
Haibao Wang *
J
Jun Kai Ho
F
Fan Cheng
S
Shuntaro Aoki
Y
Y. Muraki
M
Misato Tanaka
J
Jong-Yun Park
Y
Yukiyasu Kamitani *
DOI:10.1038/s43588-025-00826-5delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Inter-individual variability in fine-grained functional topographies poses challenges for scalable data analysis and modeling. Functional alignment techniques can help mitigate these individual differences but they typically require paired brain data with the same stimuli between individuals, which are often unavailable. Here we present a neural code conversion method that overcomes this constraint by optimizing conversion parameters based on the discrepancy between the stimulus contents represented by original and converted brain activity patterns. This approach, combined with hierarchical features of deep neural networks as latent content representations, achieves conversion accuracies that are comparable with methods using shared stimuli. The converted brain activity from a source subject can be accurately decoded using the target’s pre-trained decoders, producing high-quality visual image reconstructions that rival within-individual decoding, even with data across different sites and limited training samples. Our approach offers a promising framework for scalable neural data analysis and modeling and a foundation for brain-to-brain communication. A neural code conversion method is introduced using deep neural network representations to align brain data across individuals without shared stimuli. The approach enables accurate inter-individual brain decoding and visual image reconstruction across sites.
Keywords:
neural code conversion
inter-individual variability
functional alignment
deep neural networks
brain-to-brain communication

Journal

Nature Computational Science cover
Nature Computational Science
IF:
18.3
Papers:
3.1K
Citations:
4.0K

Organization

K
Kyoto University
Scholars:
5.1W
Papers: 4.6W
Citations: 6.1W
A
atr computational neuroscience laboratories
Scholars:
5
Papers: 4
Citations: 1