.png){kind=icon}
.png){kind=icon}
Return
SSL plus plus : Improving Self-Supervised Learning by Mitigating the Proxy Task-Specificity Problem
.png){kind=icon}
OA
AI
DOI：10.1109/TIP.2021.3135470.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
The success of deep convolutional networks (ConvNets) generally relies on a massive amount of well-labeled data, which is labor-intensive and time-consuming to collect and annotate in many scenarios. To eliminate such limitation, self-supervised learning (SSL) is recently proposed. Specifically, by solving a pre-designed proxy task, SSL is capable of capturing general-purpose features without requiring human supervision. Existing efforts focus obsessively on designing a particular proxy task but ignore the semanticity of samples that are advantageous to downstream tasks, resulting in the inherent limitation that the learned features are specific to the proxy task, namely the proxy task-specificity of features. In this work, to improve the generalizability of features learned by existing SSL methods, we present a novel self-supervised framework SSL++ to incorporate the proxy task-independent semanticity of samples into the representation learning process. Technically, SSL++ aims to leverage the complementarity, between the low-level generic features learned by a proxy task and the high-level semantic features newly learned by the generated semantic pseudo-labels, to mitigate the task-specificity and improve the generalizability of features. Extensive experiments show that SSL++ performs favorably against the state-of-the-art approaches on the established and latest SSL benchmarks.
Keywords:
Task analysis
Representation learning
Semantics
Feature extraction
Visualization
Noise measurement
Couplings
Proxy task-specificity
self-supervised learning
representation learning
convolutional neural networks
Journal
IF:
13.7
Papers:
1.0W
Citations:
8.4W
View more organizations