.png){kind=icon}
返回
Self-supervised learning with automatic data augmentation for enhancing representation
.png){kind=icon}
PRE
AI
DOI：10.1016/j.patrec.2024.06.012.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Self-supervised learning has become an increasingly popular method for learning effective representations from unlabeled data. One prominent approach in self-supervised learning is contrastive learning, which trains models to distinguish between similar and dissimilar sample pairs by pulling similar pairs closer and pushing dissimilar pairs farther apart. The key to the success of contrastive learning lies in the quality of the data augmentation, which increases the diversity of the data and helps the model learn more powerful and generalizable representations. While many studies have emphasized the importance of data augmentation, however, most of them rely on human-crafted augmentation strategies. In this paper, we propose a novel method, Self Augmentation on Contrastive Learning with Clustering (SACL), searching for the optimal data augmentation policy automatically using Bayesian optimization and clustering. The proposed approach overcomes the limitations of relying on domain knowledge and avoids the high costs associated with manually designing data augmentation rules. It automatically captures informative and useful features within the data by exploring augmentation policies. We demonstrate that the proposed method surpasses existing approaches that rely on manually designed augmentation rules. Our experiments show SACL outperforms manual strategies, achieving a performance improvement of 1.68% and 1.57% over MoCo v2 on the CIFAR10 and SVHN datasets, respectively.
Keyword:
Self-supervised learning
Contrastive learning
Auto augmentation
Clustering
期刊
IF:
3.3
论文数:
7.9K
被引数:
1.6W
机构
引用论文
Generalize d self-supervise d contrastive learning with bregman divergence for image recognition
.png){kind=icon}
PREAI
分享收藏Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks
OAAI
OAAI分享收藏
没有更多内容
没有更多内容