.png){kind=icon}
返回
Fast and Unsupervised Neural Architecture Evolution for Visual Representation Learning
.png){kind=icon}
PRE
AI
DOI：10.1109/MCI.2021.3084394.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Unsupervised visual representation learning is one of the hottest topics in computer vision, yet performance still lags behind compared with the best supervised learning methods. At the same time, neural architecture search (NAS) has produced state-of-the-art results on various visual tasks. It is a natural idea to explore NAS as a way to improve unsupervised representation learning, yet it remains largely unexplored. In this paper, we propose a Fast and Unsupervised Neural Architecture Evolution (FaUNAE) method to evolve an existing architecture, manually constructed or the result of NAS on a small dataset, to a new architecture that can operate on a larger dataset.This partial optimization can utilize prior knowledge to reduce search cost and improve search efficiency. The evolution is self-supervised where the contrast loss is used as the evaluation metric in a student-teacher framework. By eliminating the inferior or least promising operations, the evolutionary process is greatly accelerated. Experimental results show that we achieve state-of-the-art performance for downstream applications, such as object recognition, object detection, and instance segmentation.
期刊
IF:
11.2
论文数:
613
被引数:
3.1K
机构
引用论文
Transplantation of CD34+ peripheral blood progenitor cells after high- dose chemotherapy for patients with advanced multiple myeloma.png)
Blood
OAAI
BloodIF0
OAAI分享收藏Changes in metabolism affect expression of ABC transporters through ERK5 and depending on p53 statusOncotargetOAAI
OncotargetIF0
OAAI分享收藏
分享收藏
查看更多内容