arrow
Return

Conditional Stable Diffusion for Distortion Correction and Image Rectification

delete2025-05-28
delete0
PRE
AI
P
Pooja Kumari *
S
Sukhendu Das
DOI:10.1016/j.patrec.2025.04.033delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Image rectification and distortion correction are fundamental tasks in the field of image processing and computer vision, with it is applications ranging from document processing to medical imaging. This study presents a novel Conditional Stable Diffusion framework designed to tackle the challenges posed by diverse types of image distortions. Unlike existing traditional methods, our approach introduces an adaptive diffusion process that customizes its behavior based on the specific characteristics of the input image. By introducing controlled noise in a bidirectional manner, our model learns to interpret and refine various distortion patterns and progressively refines the image into a more uniform distribution. Furthermore, to complement the diffusion process, we incorporate a Guided Rectification Network (GRN) that generates reliable conditions from the input image, effectively reducing ambiguity between the distorted and target outputs. The integration of stable diffusion is justified by its versatility in handling diverse types and degrees of distortion. Our proposed method effectively handles a wide range of distortions-including projective and complex lens-based distortions such as barrel and pincushion-by dynamically adapting to each unique distortion type. Whether stemming from lens abnormalities, perspective discrepancies, or other factors, our proposed stable diffusion-based method consistently adapts to the specific characteristics of the distortion, yielding superior outcomes. Experimental results across benchmark datasets demonstrate that our method consistently outperforms existing state-of-theart approaches. Additionally, we highlight that our work is the first instance of the diffusion method being used to simultaneously address various distortion types (barrel, pincushion, lens, etc.) for multi-distortion image rectification. This Conditional Stable Diffusion framework thus offers a promising advancement for robust and versatile image distortion correction.
Keywords:
Distortion correction
Image rectification
Stable diffusion

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
7.9K
Citations:
1.6W

Organization

I
indian inst technol iit madras
Scholars:
13
Papers: 8
Citations: 2
Cited Papers

Cited Papers

Automatic correction of perspective and optical distortions
err2017-08-01
err0
errOAAI
errDaniel Santana-Cedrés; Luis Gomez; Miguel Alemán-Flores; Agustín Salgado; Julio Esclarín; Luis Mazorra; Luis Alvarez
errShare
errSave
DeepCalib
err2018-12-13
err0
PREAI
errOleksandr Bogdan; Viktor Eckstein; Francois Rameau; Jean-Charles Bazin
errShare
errSave
High-Resolution Image Synthesis with Latent Diffusion Models
err2022-06-01
err0
errOAAI
errRobin Rombach; Andreas Blattmann; Dominik Lorenz; Patrick Esser; Bjorn Ommer
errShare
errSave
WoodScape: A Multi-Task, Multi-Camera Fisheye Dataset for Autonomous Driving
err2019-10-01
err0
errOAAI
errSenthil Yogamani; Ciaran Hughes; Jonathan Horgan; Ganesh Sistu; Sumanth Chennupati; Michal Uricar; Stefan Milz; Martin Simon; Karl Amende; Christian Witt; Hazem Rashed; Sanjaya Nayak; Saquib Mansoor; Padraig Varley; Xavier Perrotton; Derek Odea; Patrick Perez
errShare
errSave
Deblurring via Stochastic Refinement
err2022-06-01
err0
errOAAI
errJay Whang; Mauricio Delbracio; Hossein Talebi; Chitwan Saharia; Alexandros G. Dimakis; Peyman Milanfar
errShare
errSave
researcher View more