arrow
Return

Object localization and edge refinement network for salient object detection

delete2023-03-01
delete16
PRE
AI
Z
Zhaojian Yao
L
Luping Wang *
DOI:10.1016/j.eswa.2022.118973delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Most existing methods mainly input images into a CNN backbone to obtain image features. However, compared with convolutional features, the recently emerging transformer features can more accurately express the meaningful features of images. In this paper, we use a transformer backbone to capture multiple feature layers of an image, and design an Object Localization and Edge Refinement (OLER) Network for saliency detection. Our network is divided into two stages, the first stage for object positioning and the second stage for refining their boundaries. In the first stage, we directly apply multiple feature layers to identify salient regions, where we design an Information Multiple Selection (IMS) module to capture saliency cues for each feature layer. The IMS module contains multiple pathways, each of which is a judgment of the location of saliency information. After the input feature layer is processed by the IMS module, its potential salient object information is mined. The second stage consists of two modules, namely the edge generation module and the edge refinement module. The edge generation module takes the original image and saliency map as inputs, and then outputs two edge maps focusing on different edge ranges. To make the object edges sharp, the original image, initial saliency map and two edge maps are fed into the edge refinement module, and the final saliency map is output. Our network as a whole is relatively simple and easy to build without involving complex components. Experimental results on five public datasets demonstrate that our method has tremendous advantages in terms of not only significantly improving detection accuracy, but also achieving better detection efficiency. The code is available at https://github.com/CKYiu/OLER.
Keywords:
Transformer features
Information multiple selection
Object localization and edge refinement
Dual edge labels

Journal

Expert Systems with Applications cover
Expert Systems with Applications
IF:
7.5
Papers:
3.0W
Citations:
10.2W

Organization

S
Sun Yat Sen University
Scholars:
9.9W
Papers: 7.2W
Citations: 95
Cited Papers

Cited Papers

errShare
errSave
Are Covert DDoS Attacks Facing Multi-Feature Detectors Feasible?
err2022-01-20
err0
PREAI
errAmir Reza Ramtin; Don Towsley; Philippe Nain; Edmundo de Souza e Silva; Daniel S. Menasche
errShare
errSave
Forecasting the carsharing service demand using uni and multivariable models
err2021-08-04
err0
errOAAI
errVictor Aquiles Alencar; Lucas Ribeiro Pessamilio; Felipe Rooke; Heder Soares Bernardino; Alex Borges Vieira
errShare
errSave
Deep Salient Object Detection With Dense Connections and Distraction Diagnosis
err2018-12-01
err54
PREAI
errXiao, Huaxin; Feng, Jiashi; Wei, Yunchao; Zhang, Maojun; Yan, Shuicheng
errShare
errSave
Saliency Detection via Multi-Scale Global Cues
err2019-07-01
err25
PREAI
errLin, Xiao; Wang, Zhi-Jie; Ma, Lizhuang; Wu, Xiabao
errShare
errSave
Measurement of Energy Access Using Fuzzy Logic
err2020-06-24
err0
errOAAI
errDiego Seuret-Jimenez; Tiare Robles-Bonilla; Karla G. Cedano
errShare
errSave
Implications of extreme events on the water balance in Java
err2021-01-01
err0
errOAAI
errIndah Susanti; Sinta Berliana Sipayung; Bambang Siswanto; Edy Maryadi; Hidayatul Latifah; Amalia Nurlatifah; Lilik S. Supriatin; Adi Witono; Mamat Suhermat
errShare
errSave
researcher View more