arrow
Return

Positional diffusion: Graph-based diffusion models for set ordering

delete2024-10-01
delete0
delete
OA
AI
F
Francesco Giuliari
G
Gianluca Scarpellini
S
Stefano Fiorini
S
Stuart James
P
Pietro Morerio *
Y
Yiming Wang
A
Alessio Del Bue
DOI:10.1016/j.patrec.2024.10.010delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Positional reasoning is the process of ordering an unsorted set of parts into a consistent structure. To address this problem, we present Positional Diffusion, a plug-and-play graph formulation with Diffusion Probabilistic Models. Using a diffusion process, we add Gaussian noise to the set elements' position and map them to a random position in a continuous space. Positional Diffusion learns to reverse the noising process and recover the original positions through an Attention-based Graph Neural Network. To evaluate our method, we conduct extensive experiments on three different tasks and seven datasets, comparing our approach against the stateof-the-art methods for visual puzzle-solving, sentence ordering, and room arrangement, demonstrating that our method outperforms long-lasting research on puzzle solving with up to +17% compared to the secondbest deep learning method, and performs on par against the state-of-the-art methods on sentence ordering and room rearrangement. Our work highlights the suitability of diffusion models for ordering problems and proposes a novel formulation and method for solving various ordering tasks. We release our code at https://github.com/IIT-PAVIS/Positional_Diffusion.
Keywords:
Graph neural networks
Diffusion probabilistic models
Positional reasoning
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Pattern Recognition Letters cover
Pattern Recognition Letters
IF:
3.3
Papers:
8.0K
Citations:
1.6W

Organization

D
Durham University
Scholars:
1.3W
Papers: 1.5W
Citations: 2.1W
I
istituto italiano di tecnologia - iit
Scholars:
9.1K
Papers: 6.9K
Citations: 8
Cited Papers

Cited Papers

Jigsaw-ViT: Learning jigsaw puzzles in vision transformer
err2023-02-01
err18
errOAAI
errChen, Yingyi; Shen, Xi; Liu, Yahui; Tao, Qinghua; Suykens, Johan A. K.
errShare
errSave
Solving archaeological puzzles
err2021-11-01
err17
errOAAI
errDerech, Niv; Tal, Ayellet; Shimshoni, Ilan
errShare
errSave
Solving Nonograms by combining relaxations
err2009-08-01
err35
PREAI
errBatenburg, K. J.; Kosters, W. A.
errShare
errSave
Self-supervised deep reconstruction of mixed strip-shredded text documents
err2020-11-01
err10
errOAAI
errPaixao, Thiago M.; Berriel, Rodrigo F.; Boeres, Maria C. S.; Koerich, Alessandro L.; Badue, Claudine; De Souza, Alberto F.; Oliveira-Santos, Thiago
errShare
errSave
Assessment of best single sample for finding chlamydia in women with and without symptoms: a diagnostic test study
errBMJ
IF0
err2012-12-12
err0
errOAAI
errS. A. Schoeman; C. M. W. Stewart; R. A. Booth; S. D. Smith; M. H. Wilcox; J. D. Wilson
errShare
errSave
Role and Effect of Persistent Organic Pollutants to Our Environment and Wildlife
err2022-04-13
err0
errOAAI
errNisha Gaur; Dhiraj Dutta; Aman Jaiswal; Rama Dubey; Dev Vrat Kamboj
errShare
errSave
Improved ArtGAN for Conditional Synthesis of Natural Image and Artwork
err2019-01-01
err46
errOAAI
errTan, Wei Ren; Chan, Chee Seng; Aguirre, Hernan E.; Tanaka, Kiyoshi
errShare
errSave
DAFNE: A dataset of fresco fragments for digital anastlylosis
err2020-10-01
err6
PREAI
errDondi, Piercarlo; Lombardi, Luca; Setti, Alessandra
errShare
errSave
researcher View more