arrow
Return

Decoding semantic sound categories in early visual cortex

delete2025-08-01
delete0
delete
OA
AI
G
Giusi Pollicina *
M
Mueller, Samuel A.
P
Polly Dalton
P
Petra Vetter *
DOI:10.1093/cercor/bhaf208delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Early visual cortex, once thought to be exclusively used for visual processes, has been shown to represent auditory information in the absence of visual stimulation. However, the exact information content of these representations is still unclear, as is their degree of specificity. Here, we acquired functional magnetic resonance imaging (fMRI) data while blindfolded human participants listened to 36 natural sounds, hierarchically organized into semantic categories. Multivoxel pattern analysis revealed that animate and inanimate sounds, as well as human, animal, vehicle, and object sounds could be decoded from fMRI activity patterns in early visual regions V1, V2, and V3. Further, pairwise classification of the different sound categories demonstrated that sounds produced by humans were represented in early visual cortex more distinctively than other semantic categories. Whole-brain searchlight analysis showed that sounds could be decoded also in higher level visual and multisensory brain regions. Our findings extend our understanding of early visual cortex function beyond visual feature processing and show that semantic and categorical sound information is represented in early visual cortex, potentially used to predict visual input.
Keywords:
audition
early visual cortex
fMRI
multisensory interaction
MVPA

Journal

C
Cerebral Cortex
IF:
2.9
Papers:
396
Citations:
0

Organization

U
University of London
Scholars:
5.1K
Papers: 2.4K
Citations: 2.9W
Cited Papers

Cited Papers

The brain uses single-trial multisensory memories to discriminate without awareness
err2005-08-01
err0
PREAI
errMicah M. Murray; John J. Foxe; Glenn R. Wylie
errShare
errSave
Attentional modulation in the human visual cortex: The time-course of the BOLD response and its implications
err2006-01-01
err0
PREAI
errAndrew T. Smith; Nathalie M. Cotillon-Williams; Adrian L. Williams
errShare
errSave
Auditory object perception: A neurobiological model and prospective review
err2017-10-01
err0
errOAAI
errJulie A. Brefczynski-Lewis; James W. Lewis
errShare
errSave
Evaluating cognitive penetrability of perception across the senses
err2024-11-18
err0
PREAI
errVetter, Petra; Badde, Stephanie; Ferre, Elisa Raffaella; Seubert, Janina; Shinn-Cunningham, Barbara
errShare
errSave
Decoding sound content in the early visual cortex of aphantasic participants
err2024-11-01
err1
errOAAI
errde la Cruz, Belen M. Montabes; Abbatecola, Clement; Luciani, Roberto S.; Paton, Angus T.; Bergmann, Johanna; Vetter, Petra; Petro, Lucy S.; Muckli, Lars F.
errShare
errSave
Naturalistic stimuli reveal a sensitive period in cross modal responses of visual cortex: Evidence from adult-onset blindness
err
IF0
err2022-07-01
err0
PREAI
errElizabeth Musz; Rita Loiotile; Janice Chen; Rhodri Cusack; Marina Bedny
errShare
errSave
errShare
errSave
Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools
err2011-04-19
err0
errOAAI
errMarcus J. Naumer; Jasper J. F. van den Bosch; Michael Wibral; Axel Kohler; Wolf Singer; Jochen Kaiser; Vincent van de Ven; Lars Muckli
errShare
errSave
researcher View more