返回
Feature selection and cascade dimensionality reduction for self-supervised visual representation learning
DOI:10.1016/j.compeleceng.2022.108570.png)
摘要
En 中文
Self-supervised visual representation learning focuses on capturing comprehensive features via exploiting the unlabeled datasets. However, existing contrastive learning based SSL frameworks are subjected to higher computational consumption and unsatisfactory performance. To handle these issues, we present a novel single-branch SSL method that incorporates an adaptive feature selection and activation module and a progressive cascade dimensionality reduction module, called APNet. Specifically, our method first fully exploits the unlabeled datasets and extracts intra-and inter-image information via introducing montage image. In addition, a novel adaptive feature selection and activation module is designed to generate the most comprehensive features. Besides, a progressive cascade dimensionality reduction module is proposed to capture the most representative features from latent vectors through cascade dimensionality increasing-decreasing operations. Extensive experiments have demonstrated the robustness and effectiveness of APNet. Specifically, APNet exceeds MoCo-v3 by 3.1% on the ImageNet-100 dataset, and consumes only half of the calculation. Code is available at https: //github.com/AI-TYQ/APNet.
Keyword:
Unsupervised learning
Feature selection and activation
Self-supervised learning
Cascade dimensionality reduction
期刊
C
IF:
4.9
论文数:
6.7K
被引数:
1.3W
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
Underwater Image Enhancement via Minimal Color Loss and Locally Adaptive Contrast Enhancement基于最小颜色损失和局部自适应对比度增强的水下图像增强

