arrow
Return

Identifying musical pieces from fMRI data using encoding and decoding models

delete2018-02-02
delete17
delete
OA
AI
S
Sebastian Hoefle
A
Annerose Engel
R
Rodrigo Basílio
V
Vinoo Alluri
P
Petri Toiviainen
M
Maurício Cagy
J
Jorge Moll *
DOI:10.1038/s41598-018-20732-3delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Encoding models can reveal and decode neural representations in the visual and semantic domains. However, a thorough understanding of how distributed information in auditory cortices and temporal evolution of music contribute to model performance is still lacking in the musical domain. We measured fMRI responses during naturalistic music listening and constructed a two-stage approach that first mapped musical features in auditory cortices and then decoded novel musical pieces. We then probed the influence of stimuli duration (number of time points) and spatial extent (number of voxels) on decoding accuracy. Our approach revealed a linear increase in accuracy with duration and a point of optimal model performance for the spatial extent. We further showed that Shannon entropy is a driving factor, boosting accuracy up to 95% for music with highest information content. These findings provide key insights for future decoding and reconstruction algorithms and open new venues for possible clinical applications.
Keywords:
AUDITORY-CORTEX
NATURAL IMAGES
BRAIN
FEATURES
REPRESENTATION
SOUND
CLASSIFICATION
FLUCTUATIONS
OBJECT
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Scientific Reports cover
Scientific Reports
IF:
3.9
Papers:
28.3W
Citations:
83.5W

Organization

U
university of jyvaskyla
Scholars:
6.3K
Papers: 6.8K
Citations: 12
I
idor - instituto d'or de ensino e pesquisa
Scholars:
814
Papers: 400
Citations: 0
U
Universidade Federal do Rio de Janeiro
Scholars:
2.9W
Papers: 1.8W
Citations: 1.6W
researcher View more organizations
Cited Papers

Cited Papers

A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain
errNEURON
IF15
err2012-12-01
err626
errOAAI
errHuth, Alexander G.; Nishimoto, Shinji; Vu, An T.; Gallant, Jack L.
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
Effects of hydrogen implantation into GaN
err1999-01-01
err0
errOAAI
errS.J. Pearton; C.R. Abernathy; R.G. Wilson; J.M. Zavada; C.Y. Song; M.G. Weinstein; M. Stavola; J. Han; R.J. Shul
errShare
errSave
Combined reconstruction of fluorescent and optical parameters using time-resolved data
err2008-12-17
err0
PREAI
errVadim Y. Soloviev; Cosimo D'Andrea; Gianluca Valentini; Rinaldo Cubeddu; Simon R. Arridge
errShare
errSave
err
IF0
err
err0
PREAI
err
errShare
errSave
The effect of ageing on the response to frusemide in normal subjects
err1984-01-01
err0
PREAI
errA. Y. Chaudhry; R. F. Bing; C. M. Castleden; J. D. Swales; C. J. Napier
errShare
errSave
Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies
err2011-10-01
err660
errOAAI
errNishimoto, Shinji; Vu, An T.; Naselaris, Thomas; Benjamini, Yuval; Yu, Bin; Gallant, Jack L.
errShare
errSave
researcher View more