arrow
Return

Deepzzle: Solving Visual Jigsaw Puzzles With Deep Learning and Shortest Path Optimization

delete2020-01-01
delete27
delete
OA
AI
M
Marie-Morgane Paumard *
D
David Picard
H
Hedi Tabia
DOI:10.1109/TIP.2019.2963378delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
We tackle the image reassembly problem with wide space between the fragments, in such a way that the patterns and colors continuity is mostly unusable. The spacing emulates the erosion of which the archaeological fragments suffer. We crop-square the fragments borders to compel our algorithm to learn from the content of the fragments. We also complicate the image reassembly by removing fragments and adding pieces from other sources. We use a two-step method to obtain the reassemblies: 1) a neural network predicts the positions of the fragments despite the gaps between them; 2) a graph that leads to the best reassemblies is made from these predictions. In this paper, we notably investigate the effect of branch-cut in the graph of reassemblies. We also provide a comparison with the literature, solve complex images reassemblies, explore at length the dataset, and propose a new metric that suits its specificities.
Keywords:
Image reassembly
jigsaw puzzle
deep learning
graph
branch-cut
cultural heritage
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Image Processing cover
IEEE Transactions on Image Processing
IF:
13.7
Papers:
1.0W
Citations:
8.4W

Organization

C
centre national de la recherche scientifique (cnrs)
Scholars:
24.5W
Papers: 18.2W
Citations: 279
U
universite gustave-eiffel
Scholars:
5.6K
Papers: 4.8K
Citations: 5
C
CY Cergy Paris Universite
Scholars:
1.6K
Papers: 1.4K
Citations: 7
researcher View more organizations