arrow
返回

Fully Convolutional Network-Based Self-Supervised Learning for Semantic Segmentation

delete2024-01-01
delete12
PRE
AI
Z
Zhengeng Yang
余
余洪山 (Hongshan Yu) *
Y
Yong He
孙伟杰 封面图
孙伟杰 (Wei Sun)
Z
Zhi‐Hong Mao
A
Ajmal Mian
DOI:10.1109/TNNLS.2022.3172423delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Although deep learning has achieved great success in many computer vision tasks, its performance relies on the availability of large datasets with densely annotated samples. Such datasets are difficult and expensive to obtain. In this article, we focus on the problem of learning representation from unlabeled data for semantic segmentation. Inspired by two patch-based methods, we develop a novel self-supervised learning framework by formulating the jigsaw puzzle problem as a patch-wise classification problem and solving it with a fully convolutional network. By learning to solve a jigsaw puzzle comprising 25 patches and transferring the learned features to semantic segmentation task, we achieve a 5.8% point improvement on the Cityscapes dataset over the baseline model initialized from random values. It is noted that we use only about 1/6 training images of Cityscapes in our experiment, which is designed to imitate the real cases where fully annotated images are usually limited to a small number. We also show that our self-supervised learning method can be applied to different datasets and models. In particular, we achieved competitive performance with the state-of-the-art methods on the PASCAL VOC2012 dataset using significantly fewer time costs on pretraining.
Keyword:
Task analysis
Semantics
Training
Feature extraction
Image segmentation
Representation learning
Indexes
Fully convolutional networks (FCNs)
representation learning
self-supervised learning
semantic segmentation

期刊

IEEE Transactions on Neural Networks and Learning Systems 封面图
IEEE Transactions on Neural Networks and Learning Systems
IF:
8.9
论文数:
7.5K
被引数:
7.2W

机构

P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
12.9W
论文数: 11.7W
被引数: 177
H
hunan university
学者数:
4.5W
论文数: 3.3W
被引数: 70
引用论文

引用论文

Small Object Augmentation of Urban Scenes for Real-Time Semantic Segmentation
err2020-01-01
err51
PREAI
errYang, Zhengeng; Yu, Hongshan; Feng, Mingtao; Sun, Wei; Lin, Xuefei; Sun, Mingui; Mao, Zhi-Hong; Mian, Ajmal
err分享
err收藏
Methods and datasets on semantic segmentation: A review
err2018-08-01
err189
PREAI
errYu, Hongshan; Yang, Zhengeng; Tan, Lei; Wang, Yaonan; Sun, Wei; Sun, Mingui; Tang, Yandong
err分享
err收藏
Polymer-cement shotcrete at the construction of the Dangara hydraulic tunnel
err1988-07-01
err0
PREAI
errV. V. Rukin; N. V. Dmitriev; V. E. Kuznetsov; A. D. Sotnikov
err分享
err收藏
err分享
err收藏
Global-Guided Selective Context Network for Scene Parsing
err2022-04-01
err11
PREAI
errJiang, Jie; Liu, Jing; Fu, Jun; Zhu, Xinxin; Li, Zechao; Lu, Hanqing
err分享
err收藏
Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning
err2022-06-01
err197
errOAAI
errLiu, Yixin; Li, Zhao; Pan, Shirui; Gong, Chen; Zhou, Chuan; Karypis, George
err分享
err收藏
Semisupervised Semantic Segmentation by Improving Prediction Confidence
err2022-09-01
err29
PREAI
errChen, Huaian; Jin, Yi; Jin, Guoqiang; Zhu, Changan; Chen, Enhong
err分享
err收藏
学者 查看更多内容