arrow
返回

Deep Multi-Look Sequence Processing for Synthetic Aperture Sonar Image Segmentation

delete2023-01-01
delete10
PRE
AI
I
Isaac D. Gerg *
V
Vishal Monga
DOI:10.1109/TGRS.2023.3234229delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep learning has enabled significant improvements in semantic image segmentation, especially in underwater imaging domains such as side scan sonar (SSS). In this work, we apply deep learning to synthetic aperture sonar (SAS) imagery, which has an advantage over traditional SSS in which SAS produces coherent high-and constant-resolution imagery. Despite the successes of deep learning, one drawback is the need for abundant labeled training data to enable success. Such abundant labeled data are not always available as in the case of SAS where collections are expensive and obtaining quality ground-truth labels may require diver intervention. To overcome these challenges, we propose a domain-specific deep learning network architecture utilizing a unique property to complex-valued SAS imagery: the ability to resolve angle-of-arrival (AoA) of acoustic returns through k-space processing. By sweeping through consecutive incrementally advanced AoA bandpass filters (a process sometimes referred to as multi-look processing), this technique generates a sequence of images emphasizing angle-dependent seafloor scattering and motion from biologics along the seafloor or in the water column. Our proposal, which we call multi look sequence processing network (MLSP-Net), is a domain enriched deep neural network architecture that models the multi look image sequence using a recurrent neural network (RNN) to extract robust features suitable for semantic segmentation of the seafloor without the need for abundant training data. Unlike previous segmentation works in SAS, our model ingests a complex-valued SAS image and affords the ability to learn the AoA filters in k-space as part of the training procedure. We show the results on a challenging real-world SAS database, and despite the lack of abundant training data, our proposed method shows superior results over state-of-the-art techniques.
Keyword:
Synthetic aperture sonar
Image segmentation
Feature extraction
Image sequences
Acoustics
Training data
Deep learning
image segmentation
recurrent neural networks (RNNs)
synthetic aperture sonar (SAS)

期刊

IEEE Transactions on Geoscience and Remote Sensing 封面图
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
论文数:
2.1W
被引数:
10.7W

机构

P
Pennsylvania State University
学者数:
3.0W
论文数: 2.6W
被引数: 7.2W
P
pennsylvania commonwealth system of higher education (pcshe)
学者数:
12.9W
论文数: 11.7W
被引数: 177
引用论文

引用论文

Nanocrystalline silicon films as multifunctional material for optoelectronic and photovoltaic applications纳米硅薄膜作为光电和光伏应用的多功能材料
err2006-10-01
err0
PREAI
errS. Pizzini; M. Acciarri; S. Binetti; D. Cavalcoli; A. Cavallini; D. Chrastina; L. Colombo; E. Grilli; G. Isella; M. Lancin; A. Le Donne; A. Mattoni; K. Peter; B. Pichaud; E. Poliani; M. Rossi; S. Sanguinetti; M. Texier; H. von Känel
err分享
err收藏
Aspects of one-carbon folate cycling related to fluoropyrimidine and antifolate therapy
err1995-01-01
err0
PREAI
errColin Paul Spears; Göran Carlsson; Franco M. Muggia; George Jaresko; Bengt G. Gustavsson
err分享
err收藏
Nano-Qubits für Quantencomputer
err2000-02-01
err0
PREAI
errGerd Schön; Yuriy Makhlin
err分享
err收藏
Analysis of Phase Error Effects on Stripmap SAS
err2009-07-01
err53
PREAI
errCook, Daniel A.; Brown, Daniel C.
err分享
err收藏
学者 查看更多内容