arrow
Return

Compression-enabled interpretability of voxelwise encoding models

delete2025-02-19
delete0
delete
OA
AI
F
Fatemeh Kamali
A
Amir Abolfazl Suratgar *
M
Mohammadbagher Menhaj
R
Reza Abbasi-Asl *
DOI:10.1371/journal.pcbi.1012822delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Voxelwise encoding models based on convolutional neural networks (CNNs) have emerged as state-of-the-art predictive models of brain activity evoked by natural movies. Despite their superior predictive performance, the huge number of parameters in CNN-based models have made them difficult to interpret. Here, we investigate whether model compression can build more interpretable and more stable CNN-based voxelwise models while maintaining accuracy. We used multiple compression techniques to prune less important CNN filters and connections, a receptive field compression method to select receptive fields with optimal center and size, and principal component analysis to reduce dimensionality. We demonstrate that the model compression improves the accuracy of identifying visual stimuli in a hold-out test set. Additionally, compressed models offer a more stable interpretation of voxelwise pattern selectivity than uncompressed models. Finally, the receptive field-compressed models reveal that the optimal model-based population receptive fields become larger and more centralized along the ventral visual pathway. Overall, our findings support using model compression to build more interpretable voxelwise models.
Keywords:
NATURAL IMAGES
REPRESENTATIONS

Journal

PLOS Biology cover
PLOS Biology
IF:
7.2
Papers:
2.1K
Citations:
3.9W

Organization

A
Amirkabir Univ Technol
Scholars:
468
Papers: 262
Citations: 73
U
UCSF
Scholars:
411
Papers: 179
Citations: 30
Cited Papers

Cited Papers

errShare
errSave
Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies
err2011-10-01
err660
errOAAI
errNishimoto, Shinji; Vu, An T.; Naselaris, Thomas; Benjamini, Yuval; Yu, Bin; Gallant, Jack L.
errShare
errSave
Convolution Models for fMRI
err2007-01-01
err0
errOAAI
errR. Henson; K. Friston
errShare
errSave
Bayesian Reconstruction of Natural Images from Human Brain Activity
errNEURON
IF15
err2009-09-01
err426
errOAAI
errNaselaris, Thomas; Prenger, Ryan J.; Kay, Kendrick N.; Oliver, Michael; Gallant, Jack L.
errShare
errSave
Deep recurrent neural network reveals a hierarchy of process memory during dynamic natural vision
err2018-02-12
err29
errOAAI
errShi, Junxing; Wen, Haiguang; Zhang, Yizhen; Han, Kuan; Liu, Zhongming
errShare
errSave
Parametric reverse correlation reveals spatial linearity of retinotopic human V1 BOLD response
err2004-09-01
err0
PREAI
errKathleen A. Hansen; Stephen V. David; Jack L. Gallant
errShare
errSave
The minimal preprocessing pipelines for the Human Connectome Project
err2013-10-01
err0
errOAAI
errMatthew F. Glasser; Stamatios N. Sotiropoulos; J. Anthony Wilson; Timothy S. Coalson; Bruce Fischl; Jesper L. Andersson; Junqian Xu; Saad Jbabdi; Matthew Webster; Jonathan R. Polimeni; David C. Van Essen; Mark Jenkinson
errShare
errSave
Variational autoencoder: An unsupervised model for encoding and decoding fMRI activity in visual cortex
err2019-09-01
err0
errOAAI
errKuan Han; Haiguang Wen; Junxing Shi; Kun-Han Lu; Yizhen Zhang; Di Fu; Zhongming Liu
errShare
errSave
researcher View more