.png){kind=icon}
返回
A spatiotemporal style transfer algorithm for dynamic visual stimulus generation
.png){kind=icon}
OA
AI
DOI：10.1038/s43588-024-00746-w.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Understanding how visual information is encoded in biological and artificial systems often requires the generation of appropriate stimuli to test specific hypotheses, but available methods for video generation are scarce. Here we introduce the spatiotemporal style transfer (STST) algorithm, a dynamic visual stimulus generation framework that allows the manipulation and synthesis of video stimuli for vision research. We show how stimuli can be generated that match the low-level spatiotemporal features of their natural counterparts, but lack their high-level semantic features, providing a useful tool to study object recognition. We used these stimuli to probe PredNet, a predictive coding deep network, and found that its next-frame predictions were not disrupted by the omission of high-level information, with human observers also confirming the preservation of low-level features and lack of high-level information in the generated stimuli. We also introduce a procedure for the independent spatiotemporal factorization of dynamic stimuli. Testing such factorized stimuli on humans and deep vision models suggests a spatial bias in how humans and deep vision models encode dynamic visual information. These results showcase potential applications of the STST algorithm as a versatile tool for dynamic stimulus generation in vision science.
Keyword:
HIERARCHICAL-MODELS
RECOGNITION
PERCEPTION
VISION
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
18.3
论文数:
3.1K
被引数:
4.0K
机构
暂无机构信息
引用论文
A Deep-Dream Virtual Reality Platform for Studying Altered Perceptual Phenomenology.png)
SCIENTIFIC REPORTSOAAI
SCIENTIFIC REPORTSIF3.9
OAAI分享收藏Yeast DNA Helicase A: Cloning, Expression, Purification, and Enzymatic CharacterizationBiochemistry
BiochemistryIF0
PREAI
分享收藏分享收藏0.18um low voltage 12-bit successive-approximation-register analog-to-digital converter (SAR ADC)
PREAI
分享收藏Dynamic Origins of Differential RNA Binding Function in Two dsRBDs from the miRNA “Microprocessor” ComplexBiochemistryOAAI
BiochemistryIF0
OAAI分享收藏分享收藏
查看更多内容