arrow
返回

A self-supervised domain-general learning framework for human ventral stream representation

delete2022-01-25
delete47
delete
OA
AI
T
Talia Konkle
G
George A. Alvarez *
DOI:10.1038/s41467-022-28091-4delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Anterior regions of the ventral visual stream encode substantial information about object categories. Are top-down category-level forces critical for arriving at this representation, or can this representation be formed purely through domain-general learning of natural image structure? Here we present a fully self-supervised model which learns to represent individual images, rather than categories, such that views of the same image are embedded nearby in a low-dimensional feature space, distinctly from other recently encountered views. We find that category information implicitly emerges in the local similarity structure of this feature space. Further, these models learn hierarchical features which capture the structure of brain responses across the human ventral visual stream, on par with category-supervised models. These results provide computational support for a domain-general framework guiding the formation of visual representation, where the proximate goal is not explicitly about category information, but is instead to learn unique, compressed descriptions of the visual world. It is unknown whether object category learning can be formed purely through domain general learning of natural image structure. Here the authors show that human visual brain responses to objects are well-captured by self-supervised deep neural network models trained without labels, supporting a domain-general account.
Keyword:
DEEP NEURAL-NETWORKS
FUNCTIONAL ARCHITECTURE
TEMPORAL CORTEX
VISUAL FEATURES
HUMAN BRAIN
RESPONSES
ORGANIZATION
VISION
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Nature Communications 封面图
Nature Communications
IF:
15.7
论文数:
9.4W
被引数:
91.2W

机构

H
Harvard University
学者数:
26.5W
论文数: 22.0W
被引数: 28.7W
引用论文

引用论文

JWA, a novel signaling molecule, involved in the induction of differentiation of human myeloid leukemia cells
err2006-03-01
err0
PREAI
errShu Huang; Qun Shen; Wen-Ge Mao; Ai-Ping Li; Jian Ye; Qi-Zhan Liu; Chang-Ping Zou; Jian-Wei Zhou
err分享
err收藏
err分享
err收藏
LINCE PLUS: Research Software for Behavior Video Analysis
err2019-07-01
err0
errOAAI
errAlberto Soto; Oleguer Camerino; Xavier Iglesias; M. Teresa Anguera; Marta Castañer
err分享
err收藏
Pressure Blade Production with a Lever in the Early and Late Neolithic of the Near East
err2012-02-07
err0
PREAI
errCiler Altınbilek-Algül; Laurence Astruc; Didier Binder; Jacques Pelegrin
err分享
err收藏
More tricks with tetramers: a practical guide to staining T cells with peptide–MHC multimers
err2015-08-04
err0
errOAAI
errGarry Dolton; Katie Tungatt; Angharad Lloyd; Valentina Bianchi; Sarah M. Theaker; Andrew Trimby; Christopher J. Holland; Marco Donia; Andrew J. Godkin; David K. Cole; Per Thor Straten; Mark Peakman; Inge Marie Svane; Andrew K. Sewell
err分享
err收藏
err分享
err收藏
学者 查看更多内容