.png){kind=icon}
返回
SSL plus plus : Improving Self-Supervised Learning by Mitigating the Proxy Task-Specificity Problem
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2021.3135470.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The success of deep convolutional networks (ConvNets) generally relies on a massive amount of well-labeled data, which is labor-intensive and time-consuming to collect and annotate in many scenarios. To eliminate such limitation, self-supervised learning (SSL) is recently proposed. Specifically, by solving a pre-designed proxy task, SSL is capable of capturing general-purpose features without requiring human supervision. Existing efforts focus obsessively on designing a particular proxy task but ignore the semanticity of samples that are advantageous to downstream tasks, resulting in the inherent limitation that the learned features are specific to the proxy task, namely the proxy task-specificity of features. In this work, to improve the generalizability of features learned by existing SSL methods, we present a novel self-supervised framework SSL++ to incorporate the proxy task-independent semanticity of samples into the representation learning process. Technically, SSL++ aims to leverage the complementarity, between the low-level generic features learned by a proxy task and the high-level semantic features newly learned by the generated semantic pseudo-labels, to mitigate the task-specificity and improve the generalizability of features. Extensive experiments show that SSL++ performs favorably against the state-of-the-art approaches on the established and latest SSL benchmarks.
Keyword:
Task analysis
Representation learning
Semantics
Feature extraction
Visualization
Noise measurement
Couplings
Proxy task-specificity
self-supervised learning
representation learning
convolutional neural networks
期刊
IF:
13.7
论文数:
1.0W
被引数:
8.4W
机构
引用论文
.png){kind=icon}
EnAET: A Self-Trained Framework for Semi-Supervised and Supervised Learning With Ensemble TransformationsEnAET: 一个自我训练的框架，用于集成转换的半监督和监督学习
OAAI
OAAI分享收藏A comparative study of efficient initialization methods for the k-means clustering algorithmK-means聚类算法高效初始化方法的比较研究
PREAI
分享收藏
查看更多内容