arrow
Return

Solving Electromagnetic Inverse Problem Using Adaptive Gradient Descent Algorithm

delete2023-01-01
delete7
PRE
AI
L
Lian Liu
杨
杨波 (Bo Yang) *
Y
Yi Zhang
Y
Yixian Xu
F
Feng Wang
DOI:10.1109/TGRS.2023.3239106delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The nonlinear conjugate gradient (NLCG) algorithm is one of the popular linearized methods used to solve the frequency-domain electromagnetic (EM) geophysical inverse problem. During NLCG iterations, the model gradient guides the searching direction while the line-search algorithm determines the step length of each iteration. Normally, the line search requires solving the corresponding forward problem a few times. Since line search is usually computationally inefficient, we introduce the adaptive gradient descent (AGD) algorithm to accelerate solving the frequency-domain EM inverse problem within the linearized framework. The AGD algorithm is a variant of the classical gradient descent method and has been well-developed and widely used in deep learning. Rather than the time-consuming line search, its core idea is to algebraically manipulate the cumulative gradients and updates of the model from previous iterations to estimate the model parameter variables at the current iteration. For the inversion of magnetotelluric (MT) data, we here designed and implemented a framework using the AGD algorithm combined with the cool-down scheme to tune the regularization parameter. To improve the convergence performance of the AGD algorithm [specifying to Adam and root-mean-square propagation (RMSProp)], we proposed a tolerance strategy which has been tested numerically. To optimize the global learning rate, we carried out some comparative trials in the proposed inversion framework. The inverted results of synthetic and real-world data showed that both the AGD algorithms (Adam and RMSProp) can recover comparable results and save more than a third of CPU time compared with the NLCG algorithm.
Keywords:
Mathematical models
Linear programming
Inverse problems
Deep learning
Computational modeling
Costs
Search problems
Adaptive gradient descent (AGD) algorithm
cool-down
inverse problem
magnetotelluric (MT)

Journal

IEEE Transactions on Geoscience and Remote Sensing cover
IEEE Transactions on Geoscience and Remote Sensing
IF:
8.6
Papers:
2.2W
Citations:
10.7W

Organization

Z
Zhejiang Wanli University
Scholars:
1.3K
Papers: 914
Citations: 1.1K
Z
zhejiang university
Scholars:
17.7W
Papers: 12.1W
Citations: 152
Cited Papers

Cited Papers

Parkinson's Disease Iron Deposition Caused by Nitric Oxide-Induced Loss of β-Amyloid Precursor Protein
err2015-02-25
err0
errOAAI
errScott Ayton; Peng Lei; Dominic J. Hare; James A. Duce; Jessica L. George; Paul A. Adlard; Catriona McLean; Jack T. Rogers; Robert A. Cherny; David I. Finkelstein; Ashley I. Bush
errShare
errSave
SIMPEG: An open source framework for simulation and gradient based parameter estimation in geophysical applications
err2015-12-01
err212
errOAAI
errCockett, Rowan; Kang, Seogi; Heagy, Lindsey J.; Pidlisecky, Adam; Oldenburg, Douglas W.
errShare
errSave
Eating Disorders
err2021-06-18
err0
PREAI
errDeborah Michel and Amanda Venta
errShare
errSave
researcher View more