.png){kind=icon}
返回
S 4: Self-supervised learning with sparse-dense sampling
.png){kind=icon}
PRE
AI
DOI：10.1016/j.knosys.2024.112040.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Self -supervised visual representation learning (SSL) attempts to extract significant features from unlabeled datasets, alleviating the necessity for labor-intensive and time-consuming manual labeling processes. However, existing contrastive learning -based methods typically suffer from the underutilization of datasets, consume significant computational resources, and employ longer training epochs or large batch sizes. In this study, we propose a novel method aimed at optimizing self -supervised learning that integrates the advantages of sparse -dense sampling and collaborative optimization, thereby significantly improving the performance of downstream tasks. Specifically, sparse -dense sampling primarily focuses on high-level semantic features, while leveraging the spatial structure relationship provided by the unlabeled dataset to ensure the incorporation of low-level texture features to improve data utilization. Besides, collaborative optimization, including contrastive and location tasks, further enhances the model's ability to perceive features of different dimensions, thereby improving its utilization of features in the embedding space. Furthermore, the combination of sparse -dense sampling and collaborative optimization strategies can reduce computational consumption while improving performance. Extensive experiments demonstrate that the proposed method effectively reduces the computational requirements while delivering favorable results. The codes and model weights will be available at https://github.com/AI-TYQ/S4.
Keyword:
Self-supervised visual representation learning
Sparse-dense sampling
Collaborative optimization
期刊
K
IF:
7.6
论文数:
1.3W
被引数:
4.5W
机构
引用论文
.png){kind=icon}
Role of interfacial phenomena in the behavior of alumina-supported palladium crystallites in oxygen
PREAI
分享收藏
查看更多内容