arrow
返回

Remote sensing image instance segmentation network with transformer and multi-scale feature representation

delete2023-12-01
delete12
PRE
AI
W
Wenhui Ye
张
张巍 (Wei Zhang) *
W
Weimin Lei
W
Wenchao Zhang
X
Xinyi Chen
W
Wang, Yanwen
DOI:10.1016/j.eswa.2023.121007delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
The goal of remote sensing image (RSI) instance segmentation is to perform instance-level semantic parsing of its contents. Aside from classifying and locating regions of interest (RoI), it also requires assigning finer pixel -wise annotations to objects. However, RSI often suffers from cluttered backgrounds, variable object scales, and complex object edge contours, making the instance segmentation task more challenging. In this work, we analytically customize an instance segmentation model that is more suitable for RSI. Specifically, we propose three novel modules for a region-based instance segmentation framework, namely Channel-Spatial Attention Module (CSA), Multi-Scale Aware Module (MSA), and Semantic Relation Learning Module (SRL). Among them, feature calibration performed by CSA can alleviate the semantic gap between low-level features and high-level semantics in both channel and spatial dimensions. Inheriting the capabilities of both the convolutional neural network (CNN) and the Transformer, SRL can help the network integrate both neighborhood features and long-range dependencies for instance semantic prediction. The MSA module designs a cascaded residual structure with different receptive fields to model the scale variation of objects in RSI. Experimental results on challenging ISAID, NWPU VHR-10, SSDD, BITTC and HRSID datasets demonstrate the superiority of our method, achieving mask APs of 40.2%, 68.2%, 68.4%, 50.4% and 55.8% respectively. Code and pretrained models are available at https://github.com/Sherlock1018/RSIISN.
Keyword:
Remote sensing image
Instance segmentation
Region-based
Long-range dependencies

期刊

Expert Systems with Applications 封面图
Expert Systems with Applications
IF:
7.5
论文数:
3.0W
被引数:
10.2W

机构

X
xi'an university of science & technology
学者数:
6.9K
论文数: 4.8K
被引数: 5
N
northeastern university - china
学者数:
3.2W
论文数: 2.7W
被引数: 37
引用论文

引用论文

Conductivity Enhancement in Thin Silicon-on-Insulator Layer Embedding Artificial Dislocation Network
err2011-02-01
err0
PREAI
errYasuhiko Ishikawa; Kazuaki Yamauchi; Chihiro Yamamoto; Michiharu Tabe
err分享
err收藏
err分享
err收藏
Swine viral detection by adapted Next-Generation Sequencing (NGS) for RNA and DNA species reveals first detection of porcine circovirus type 3 (PCV3) in Chile
err
IF0
err2020-06-09
err0
errOAAI
errPaulina S. Rubilar; Javier Tognarelli; Jorge Fernández; Cristóbal Valdés; Felipe Broitman; Dinka Mandakovic; Rodrigo Pulgar
err分享
err收藏
学者 查看更多内容