arrow
Return

DMHomo: Learning Homography with Diffusion Models

delete2024-04-09
delete0
PRE
AI
H
Haipeng Li
A
Ao Luo
P
Ping Tan
H
Haoqiang Fan
B
Bing Zeng
S
Shuaicheng Liu *
DOI:10.1145/3652207delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Supervised homography estimation methods face a challenge due to the lack of adequate labeled training data. To address this issue, we propose DMHomo, a diffusion model-based framework for supervised homography learning. This framework generates image pairs with accurate labels, realistic image content, and realistic intervalmotion, ensuring that they satisfy adequate pairs. We utilize unlabeled image pairs with pseudo labels such as homography and dominant plane masks, computed from existing methods, to train a diffusion model that generates a supervised training dataset. To further enhance performance, we introduce a new probabilistic mask loss, which identifies outlier regions through supervised training, and an iterative mechanism to optimize the generative and homography models successively. Our experimental results demonstrate that DMHomo effectively overcomes the scarcity of qualified datasets in supervised homography learning and improves generalization to real-world scenes. The code and dataset are available at GitHub (https://github.com/lhaippp/DMHomo).
Keywords:
Homography
diffusion models
image alignment
datasets

Journal

ACM Transactions on Graphics cover
ACM Transactions on Graphics
IF:
9.5
Papers:
4.7K
Citations:
3.6W

Organization

S
sichuan university
Scholars:
11.9W
Papers: 7.7W
Citations: 100