arrow
返回

Deep Rotation Correction Without Angle Prior

delete2023-01-01
delete4
delete
OA
AI
聂浪 封面图
聂浪 (Lang Nie)
林
林春雨 (Chunyu Lin) *
K
Kang Liao
S
Shuaicheng Liu
赵
赵耀 (Yao Zhao)
DOI:10.1109/TIP.2023.3275869delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Not everybody can be equipped with professional photography skills and sufficient shooting time, and there can be some tilts in the captured images occasionally. In this paper, we propose a new and practical task, named Rotation Correction, to automatically correct the tilt with high content fidelity in the condition that the rotated angle is unknown. This task can be easily integrated into image editing applications, allowing users to correct the rotated images without any manual operations. To this end, we leverage a neural network to predict the optical flows that can warp the tilted images to be perceptually horizontal. Nevertheless, the pixel-wise optical flow estimation from a single image is severely unstable, especially in large-angle tilted images. To enhance its robustness, we propose a simple but effective prediction strategy to form a robust elastic warp. Particularly, we first regress the mesh deformation that can be transformed into robust initial optical flows. Then we estimate residual optical flows to facilitate our network the flexibility of pixel-wise deformation, further correcting the details of the tilted images. To establish an evaluation benchmark and train the learning framework, a comprehensive rotation correction dataset is presented with a large diversity in scenes and rotated angles. Extensive experiments demonstrate that even in the absence of the angle prior, our algorithm can outperform other state-of-the-art solutions requiring this prior. The code and dataset are available at https://github.com/nie-lang/RotationCorrection.
Keyword:
Optical imaging
Adaptive optics
Optical distortion
Nonlinear optics
Deformation
Robustness
Task analysis
Computer vision
rotation correction
mesh deformation
optical flow

期刊

IEEE Transactions on Image Processing 封面图
IEEE Transactions on Image Processing
IF:
13.7
论文数:
1.0W
被引数:
8.4W

机构

B
Beijing Jiaotong University
学者数:
2.2W
论文数: 1.7W
被引数: 1.2W
引用论文

引用论文

Rectangling irregular videos by optimal spatio-temporal warping
err2022-03-01
err5
errOAAI
errWu, Jin-Liang; Shi, Jun-Jie; Zhang, Lei
err分享
err收藏
Cycle-IR: Deep Cyclic Image Retargeting
err2020-07-01
err32
errOAAI
errTan, Weimin; Yan, Bo; Lin, Chumin; Niu, Xuejing
err分享
err收藏
Dynamic shortest route finder using pgRouting for emergency management
err2015-07-23
err0
PREAI
errPuyam S. Singh; Rosly B. Lyngdoh; Dibyajyoti Chutia; Victor Saikhom; Bhargav Kashyap; S. Sudhakar
err分享
err收藏
err分享
err收藏
Public Perceptions of Environmental Public Health Risks in the United States
err2019-03-22
err0
errOAAI
errMikyong Shin; Angela K. Werner; Heather Strosnider; Lisa B. Hines; Lina Balluz; Fuyuen Y. Yip
err分享
err收藏
学者 查看更多内容