arrow
Return

PixelSync: Enhancing Texture Generation via Explicit Feature Synchronization

delete2026-05-01
delete0
PRE
AI
D
Drescher, Philipp *
E
Edoardo Alberto Dominici
K
Konstantinos Vardis
M
Markus Steinberger
DOI:10.1145/3804489delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The generation of consistent multi-view images is essential for diffusion-based 3D texture synthesis, a key component of modern 3D content pipelines. However, existing methods remain weakly coupled across viewpoints, often exhibiting inconsistencies between views that result in artifacts such as ghosting, misalignment, and texture distortions. We introduce PixelSync, a training-free mechanism that explicitly enforces multi-view consistency during the diffusion process. Our method operates in two stages. First, we compute visibility-aware pixel correspondences between known views in a fast pre-computation step by utilizing geometric information obtained from a given 3D model. Then, during the diffusion process, we enforce consistency through two complementary algorithms: (i) attention synchronization, by modifying the attention scores in the U-Net's down-and mid-blocks, and (ii) latent synchronization, by progressively aligning features on their corresponding shared pixels. PixelSync can be seamlessly integrated into pre-trained diffusion models without retraining, offering a lightweight and effective solution. We demonstrate the effectiveness of our approach for generative texture synthesis by plugging PixelSync into established multi-view diffusion backbones, showcasing reduced cross-view artifacts and improved global coherence across standard quantitative and qualitative evaluations.
Keywords:
multi-view
training-free
texture generation

Journal

P
Proceedings of the ACM on Computer Graphics and Interactive Techniques
IF:
2.3
Papers:
17
Citations:
0

Organization

G
graz university of technology
Scholars:
833
Papers: 382
Citations: 0
Cited Papers

Cited Papers

High-Resolution Image Synthesis with Latent Diffusion Models
err2022-06-01
err0
errOAAI
errRobin Rombach; Andreas Blattmann; Dominik Lorenz; Patrick Esser; Bjorn Ommer
errShare
errSave
CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets
err2024-07-19
err1
errOAAI
errZhang, Longwen; Wang, Ziyu; Zhang, Qixuan; Qiu, Qiwei; Pang, Anqi; Jiang, Haoran; Yang, Wei; Xu, Lan; Yu, Jingyi
errShare
errSave
Text2Tex: Text-driven Texture Synthesis via Diffusion Models
err2023-10-01
err0
errOAAI
errDave Zhenyu Chen; Yawar Siddiqui; Hsin-Ying Lee; Sergey Tulyakov; Matthias Nießner
errShare
errSave
EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion
err2024-06-16
err0
PREAI
errHuang,Zehuan; Wen,Hao; Dong,Junting; Wang,Yaohui; Li,Yangguang; Chen,Xinyuan; Cao,Yan-Pei; Liang,Ding; Qiao,Yu; Dai,Bo; Sheng,Lu
errShare
errSave
FLIP
err2020-08-26
err0
errOAAI
errPontus Andersson; Jim Nilsson; Tomas Akenine-Möller; Magnus Oskarsson; Kalle Åström; Mark D. Fairchild
errShare
errSave
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
err2024-06-16
err0
PREAI
errLukas Höllein; Aljaž Božič; Norman Müller; David Novotny; Hung-Yu Tseng; Christian Richardt; Michael Zollhöfer; Matthias Nießner
errShare
errSave
MVDD: Multi-view Depth Diffusion Models
err2025-01-01
err0
PREAI
errWang,Zhen; Xu,Qiangeng; Tan,Feitong; Chai,Menglei; Liu,Shichen; Pandey,Rohit; Fanello,Sean; Kadambi,Achuta; Zhang,Yinda
errShare
errSave
researcher View more