arrow
Return

Improving CNN-based semantic segmentation on structurally similar data using contrastive graph convolutional networks

delete2024-11-01
delete0
PRE
AI
L
Ling Chen *
Z
Zedong Tang
H
Hao Li
DOI:10.1016/j.patcog.2024.110622delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Structurally similar data exist in most practical semantic segmentation applications. For example, objects can appear identical or positionally similar in many images, such as video frames. Objects with structural similarity in data samples can confuse deep neural networks (DNNs) in semantic segmentation applications. These challenges often lead to lower pixel classification accuracy of natural object segmentation. This study proposes a novel approach (S2-GCN) that enhances CNN -based semantic segmentation for structurally similar data using a contrastive graph convolutional network (GCN). By selecting specific label pairs and developing a customized GCN branch parallel to an encoder -decoder backbone, our method significantly improves accuracy, IoU, and F1score, by up to 8 %, as demonstrated through an extensive evaluation of five datasets. Our findings show that the proposed method effectively addresses the structural similarity problem of CNN -based semantic segmentation and can be applied to a wide range of practical applications.
Keywords:
Semantic segmentation
Structural similarity
Graph network
Contrastive learning

Journal

Pattern Recognition cover
Pattern Recognition
IF:
7.6
Papers:
1.3W
Citations:
4.5W

Organization

X
Xidian University
Scholars:
2.4W
Papers: 1.9W
Citations: 9.7K
Cited Papers

Cited Papers

A multi-strategy contrastive learning framework for weakly supervised semantic segmentation
err2023-05-01
err14
errOAAI
errYuan, Kunhao; Schaefer, Gerald; Lai, Yu-Kun; Wang, Yifan; Liu, Xiyao; Guan, Lin; Fang, Hui
errShare
errSave
Self-Supervised Learning for Few-Shot Medical Image Segmentation
err2022-07-01
err62
errOAAI
errOuyang, Cheng; Biffi, Carlo; Chen, Chen; Kart, Turkay; Qiu, Huaqi; Rueckert, Daniel
errShare
errSave
Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV
err2015-01-01
err0
PREAI
errC. Perréard; Y. Ladner; F. d'Orlyé; S. Descroix; V. Taniga; A. Varenne; F. Kanoufi; C. Slim; S. Griveau; F. Bedioui
errShare
errSave
Self-Supervised Leaf Segmentation under Complex Lighting Conditions
err2023-03-01
err15
errOAAI
errLin, Xufeng; Li, Chang-Tsun; Adams, Scott; Kouzani, Abbas Z.; Jiang, Richard; He, Ligang; Hu, Yongjian; Vernon, Michael; Doeven, Egan; Webb, Lawrence; Mcclellan, Todd; Guskich, Adam
errShare
errSave
Learning pseudo labels for semi-and-weakly supervised semantic segmentation
err2022-12-01
err9
PREAI
errWang, Yude; Zhang, Jie; Kan, Meina; Shan, Shiguang
errShare
errSave
Use of simplex search in active shape models for improved boundary segmentation
err2010-07-01
err8
PREAI
errArambula Cosio, F.; Marquez Flores, J. A.; Padilla Castaneda, M. A.
errShare
errSave
Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges
err2021-03-01
err725
errOAAI
errFeng, Di; Haase-Schutz, Christian; Rosenbaum, Lars; Hertlein, Heinz; Glaser, Claudius; Timm, Fabian; Wiesbeck, Werner; Dietmayer, Klaus
errShare
errSave
researcher View more