.png){kind=icon}
.png){kind=icon}
Return
Reference-aware image harmonization
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2025.108439.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Image harmonization is a crucial task in image composition and editing, which aims to adjust the foreground to harmonious with the background. Due to the lack of clear reference standards for foreground appearance adjustment, image harmonization is a highly ill-posed problem. Recent works have shown that the appearance of similar content between the background and foreground can provide reliable guidance to reduce this ill-posedness. However, when there is no similar content to the foreground object in the background, these methods often fail achieve satisfactory results. To address this problem, we propose a Reference-Aware Image Harmonization Network (RANet). First, we introduce a Style-aware Reference Module that utilizes a diffusion model as an estimator to generate reference style features, thereby achieving global style alignment. Second, we design a Region-aware Reference Module that adaptively identifies and utilizes relevant reference regions between the foreground and background by predicting soft masks, effectively avoiding interference from irrelevant background areas while leveraging useful reference information from the background for better local visual consistency. Experiments on the iHarmony4 dataset and a real mobile phone captured dataset validate the effectiveness of our method. The code and the new dataset are available at https://github.com/thenotshyshyshy/Reference-Aware-Image-Harmonization.
Keywords:
Image harmonization
Image editing
Appearance translation
Diffusion model