返回
Deep Multi-Look Sequence Processing for Synthetic Aperture Sonar Image Segmentation
DOI:10.1109/TGRS.2023.3234229.png)
摘要
En 中文
Deep learning has enabled significant improvements in semantic image segmentation, especially in underwater imaging domains such as side scan sonar (SSS). In this work, we apply deep learning to synthetic aperture sonar (SAS) imagery, which has an advantage over traditional SSS in which SAS produces coherent high-and constant-resolution imagery. Despite the successes of deep learning, one drawback is the need for abundant labeled training data to enable success. Such abundant labeled data are not always available as in the case of SAS where collections are expensive and obtaining quality ground-truth labels may require diver intervention. To overcome these challenges, we propose a domain-specific deep learning network architecture utilizing a unique property to complex-valued SAS imagery: the ability to resolve angle-of-arrival (AoA) of acoustic returns through k-space processing. By sweeping through consecutive incrementally advanced AoA bandpass filters (a process sometimes referred to as multi-look processing), this technique generates a sequence of images emphasizing angle-dependent seafloor scattering and motion from biologics along the seafloor or in the water column. Our proposal, which we call multi look sequence processing network (MLSP-Net), is a domain enriched deep neural network architecture that models the multi look image sequence using a recurrent neural network (RNN) to extract robust features suitable for semantic segmentation of the seafloor without the need for abundant training data. Unlike previous segmentation works in SAS, our model ingests a complex-valued SAS image and affords the ability to learn the AoA filters in k-space as part of the training procedure. We show the results on a challenging real-world SAS database, and despite the lack of abundant training data, our proposed method shows superior results over state-of-the-art techniques.
Keyword:
Synthetic aperture sonar
Image segmentation
Feature extraction
Image sequences
Acoustics
Training data
Deep learning
image segmentation
recurrent neural networks (RNNs)
synthetic aperture sonar (SAS)
期刊
IF:
8.6
论文数:
2.1W
被引数:
10.7W
机构
引用论文
Abating whey organic load through ethanol and lactic acid production by kefir通过克菲尔发酵生产乙醇和乳酸以降低乳清有机负荷
Crystalline‐State Reaction with Allosteric Effect in Spin‐Crossover, Interpenetrated Networks with Magnetic and Optical Bistability具有磁和光学双稳态的自旋交叉,互穿网络中具有变构效应的晶态反应
Fast Target Detection in Synthetic Aperture Sonar Imagery: A New Algorithm and Large-Scale Performance Analysis合成孔径声纳图像中的快速目标检测: 一种新算法和大规模性能分析
Nanocrystalline silicon films as multifunctional material for optoelectronic and photovoltaic applications纳米硅薄膜作为光电和光伏应用的多功能材料

