arrow
返回

Feature selection and cascade dimensionality reduction for self-supervised visual representation learning

delete2023-03-01
delete2
PRE
AI
P
Peixin Qu
S
Songlin Jin
Y
Ying Zheng
张
张卫东 (Weidong Zhang)
Y
Yibo Xu
X
Xipeng Pan *
W
Wenyi Zhao *
DOI:10.1016/j.compeleceng.2022.108570delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Self-supervised visual representation learning focuses on capturing comprehensive features via exploiting the unlabeled datasets. However, existing contrastive learning based SSL frameworks are subjected to higher computational consumption and unsatisfactory performance. To handle these issues, we present a novel single-branch SSL method that incorporates an adaptive feature selection and activation module and a progressive cascade dimensionality reduction module, called APNet. Specifically, our method first fully exploits the unlabeled datasets and extracts intra-and inter-image information via introducing montage image. In addition, a novel adaptive feature selection and activation module is designed to generate the most comprehensive features. Besides, a progressive cascade dimensionality reduction module is proposed to capture the most representative features from latent vectors through cascade dimensionality increasing-decreasing operations. Extensive experiments have demonstrated the robustness and effectiveness of APNet. Specifically, APNet exceeds MoCo-v3 by 3.1% on the ImageNet-100 dataset, and consumes only half of the calculation. Code is available at https: //github.com/AI-TYQ/APNet.
Keyword:
Unsupervised learning
Feature selection and activation
Self-supervised learning
Cascade dimensionality reduction

期刊

C
Computers and Electrical Engineering
IF:
4.9
论文数:
6.7K
被引数:
1.3W

机构

B
beijing university of posts & telecommunications
学者数:
1.4W
论文数: 1.2W
被引数: 9
H
henan institute of science & technology
学者数:
2.7K
论文数: 1.8K
被引数: 3
G
Guilin University of Electronic Technology
学者数:
7.4K
论文数: 5.2K
被引数: 5.4K
学者 查看更多机构
引用论文

引用论文

Deep Fuzzy Hashing Network for Efficient Image Retrieval
err2021-01-01
err268
PREAI
errLu, Huimin; Zhang, Ming; Xu, Xing; Li, Yujie; Shen, Heng Tao
err分享
err收藏
Endothelial cell migration, adhesion and proliferation on different polymeric substrates
err2019-02-22
err0
PREAI
errAnne Krüger-Genge; Stefanie Dietze; Wan Yan; Yue Liu; Liang Fang; Karl Kratz; Andreas Lendlein; Friedrich Jung
err分享
err收藏
Overlay Cognitive ABCom-NOMA-Based ITS: An In-Depth Secrecy Analysis
err2022-01-01
err20
errOAAI
errZheng, Yike; Li, Xingwang; Zhang, Hui; Alshehri, Mohammad Dahman; Dang, Shuping; Huang, Gaojian; Zhang, Changsen
err分享
err收藏
err分享
err收藏
The PASCAL Visual Object Classes Challenge: A RetrospectivePASCAL视觉对象课程挑战: 回顾性
err2014-06-25
err5.0K
PREAI
errEveringham, Mark; Eslami, S. M. Ali; Van Gool, Luc; Williams, Christopher K. I.; Winn, John; Zisserman, Andrew
err分享
err收藏
学者 查看更多内容