arrow
Return

Adversarial Training for Solving Inverse Problems in Image Processing

delete2021-01-01
delete11
PRE
AI
Z
Zhengxia Zou *
T
Tianyang Shi
Z
Zhenwei Shi
J
Jieping Ye
DOI:10.1109/TIP.2021.3053398delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Inverse problems are a group of important mathematical problems that aim at estimating source data x and operation parameters z from inadequate observations y. In the image processing field, most recent deep learning-based methods simply deal with such problems under a pixel-wise regression framework (from y to x) while ignoring the physics behind. In this paper, we re- examine these problems under a different viewpoint and propose a novel framework for solving certain types of inverse problems in image processing. Instead of predicting x directly from y, we train a deep neural network to estimate the degradation parameters z under an adversarial training paradigm. We show that if the degradation behind satisfies some certain assumptions, the solution to the problem can be improved by introducing additional adversarial constraints to the parameter space and the training may not even require pair-wise supervision. In our experiment, we apply our method to a variety of real-world problems, including image denoising, image deraining, image shadow removal, non-uniform illumination correction, and underdetermined blind source separation of images or speech signals. The results on multiple tasks demonstrate the effectiveness of our method.
Keywords:
Training
Inverse problems
Degradation
Image processing
Task analysis
Linear programming
Image denoising
Inverse problem
deep learning
generative adversarial networks
bidirectional mapping
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

B
Beihang University
Scholars:
5.2W
Papers: 4.1W
Citations: 37
U
University of Michigan
Scholars:
6.4W
Papers: 5.3W
Citations: 124
U
university of michigan system
Scholars:
9.1W
Papers: 8.6W
Citations: 133
researcher View more organizations
Cited Papers

Cited Papers

errShare
errSave
errShare
errSave
Synthesis and Characterization of Cerium(IV) Metallocenes
err2015-12-11
err0
errOAAI
errAndrew Sutton; David Clark; Brian Scott; John Gordon
errShare
errSave
Signal Intensities in Preoperative MRI Do Not Reflect Proliferative Activity in Meningioma
err2016-08-01
err0
errOAAI
errStefan Schob; Clara Frydrychowicz; Matthias Gawlitza; Lionel Bure; Matthias Preuß; Karl-Titus Hoffmann; Alexey Surov
errShare
errSave
Diagnostic and prognostic significance of squamous cell carcinoma antigen in non-small cell lung cancer
err2001-05-01
err0
PREAI
errTheodoros Vassilakopoulos; Theodoros Troupis; Christina Sotiropoulou; Panagiotis Zacharatos; Paraskevi Katsaounou; Dimitrios Parthenis; Olga Noussia; George Troupis; Spyros Papiris; Christos Kittas; Charis Roussos; Spyros Zakynthinos; Vassilios Gorgoulis
errShare
errSave
researcher View more