arrow
Return

Geometry guidance diffusion image morphing with large shape difference

delete2025-05-19
delete0
PRE
AI
Y
Yi Jiang
Y
Yiqian Wu
H
Hao Xu
S
Shi, Xiwen
DOI:10.1007/s00371-025-03939-0delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Image diffusion models have facilitated the generation of visually compelling images, and this powerful generative capability has also opened new avenues for tasks such as image morphing. Previous diffusion model-based image morphing approaches primarily focus on interpolating text embeddings and latent vectors. However, directly interpolating high-level features ignores explicit shape control, leading to morphing processes that lack smooth shape transitions. Moreover, unconstrained interpolation can drive results outside the diffusion model's domain, resulting in noticeable artifacts. To address these issues, we propose a novel diffusion model-based method that ensures smooth shape transitions. To overcome the lack of explicit shape control, our key idea is to utilize normal maps as geometric guidance for precise image morphing. By integrating 3D reconstruction techniques with variational implicit surface methods, our approach ensures smoother and more stable morphing sequences, preserving shape consistency throughout the transformation. Comparative experiments demonstrate that our method produces smooth, consistent, and stable results and outperforms existing SOTA techniques, such as IMPUS and DiffMorpher, especially when dealing with images with large shape differences.
Keywords:
Image morphing
Diffusion model
Geometric guidance

Journal

Visual Computer cover
Visual Computer
IF:
2.9
Papers:
4.6K
Citations:
6.5K

Organization

No organization information available
Cited Papers

Cited Papers

High-Resolution Image Synthesis with Latent Diffusion Models
err2022-06-01
err0
errOAAI
errRobin Rombach; Andreas Blattmann; Dominik Lorenz; Patrick Esser; Bjorn Ommer
errShare
errSave
errShare
errSave
ReconFusion: 3D Reconstruction with Diffusion Priors
err2024-06-16
err0
PREAI
errRundi Wu; Ben Mildenhall; Philipp Henzler; Keunhong Park; Ruiqi Gao; Daniel Watson; Pratul P. Srinivasan; Dor Verbin; Jonathan T. Barron; Ben Poole; Aleksander Hołyński
errShare
errSave
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation
err2020-11-03
err0
PREAI
errXingang Pan; Xiaohang Zhan; Bo Dai; Dahua Lin; Chen Change Loy; Ping Luo
errShare
errSave
Wonder3D: Single Image to 3D Using Cross-Domain Diffusion
err2024-06-16
err0
PREAI
errXiaoxiao Long; Yuan-Chen Guo; Cheng Lin; Yuan Liu; Zhiyang Dou; Lingjie Liu; Yuexin Ma; Song-Hai Zhang; Marc Habermann; Christian Theobalt; Wenping Wang
errShare
errSave
researcher View more