arrow
返回

Escaping the big data paradigm in self-supervised representation learning

delete2026-02-28
delete0
PRE
AI
C
Carlos García *
M
Miguel Cazorla
J
Jorge Pomares
DOI:10.1016/j.cviu.2026.104698delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
• SCOTT:与MIM兼容的卷积分词器,通过稀疏架构将CNN偏差注入ViTs。 • MIM-JEPA:基于掩码图像建模的JEPA,用于样本高效视觉表示学习。 • 高效数据ViTs:SCOTT+MIM-JEPA在有限数据条件下优于先前方法。 • 低资源SSL:在适度的计算预算下匹配大型基础SSL模型。
Keyword:
SCOTT
MIM-JEPA
Data-efficient ViTs
Low-resource SSL
Self-supervised representation learning

期刊

Computer Vision and Image Understanding 封面图
Computer Vision and Image Understanding
IF:
3.5
论文数:
555
被引数:
7.3K

机构

U
university of alicante
学者数:
545
论文数: 224
被引数: 0
A
automation and robotics
学者数:
1
论文数: 1
被引数: 0
引用论文

引用论文

Emerging Properties in Self-Supervised Vision Transformers自监督视觉变换器中的新兴特性
err2021-10-01
err0
errOAAI
errMathilde Caron; Hugo Touvron; Ishan Misra; Herve Jegou; Julien Mairal; Piotr Bojanowski; Armand Joulin
err分享
err收藏
Backpropagation Applied to Handwritten Zip Code Recognition反向传播在手写邮政编码识别中的应用
err1989-12-01
err0
PREAI
errY. LeCun; B. Boser; J. S. Denker; D. Henderson; R. E. Howard; W. Hubbard; L. D. Jackel
err分享
err收藏
SparseSwin: Swin transformer with sparse transformer block
err2024-05-01
err8
errOAAI
errPinasthika, Krisna; Laksono, Blessius Sheldo Putra; Irsal, Riyandi Banovbi Putera; Shabiyya, Syifa Hukma; Yudistira, Novanto
err分享
err收藏
Self-supervised learning for medical image classification: a systematic review and implementation guidelines
err2023-04-26
err79
errOAAI
errHuang, Shih-Cheng; Pareek, Anuj; Jensen, Malte; Lungren, Matthew P.; Yeung, Serena; Chaudhari, Akshay S.
err分享
err收藏
LeViT: a Vision Transformer in ConvNet’s Clothing for Faster Inference
err2021-10-01
err0
errOAAI
errBen Graham; Alaaeldin El-Nouby; Hugo Touvron; Pierre Stock; Armand Joulin; Herve Jegou; Matthijs Douze
err分享
err收藏
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
err2023-06-01
err0
errOAAI
errMahmoud Assran; Quentin Duval; Ishan Misra; Piotr Bojanowski; Pascal Vincent; Michael Rabbat; Yann LeCun; Nicolas Ballas
err分享
err收藏
学者 查看更多内容