arrow
返回

Texture-Generic Deep Shape-From-Template

delete2021-01-01
delete9
delete
OA
AI
D
David Fuentes-Jiménez *
D
Daniel Pizarro
D
David Casillas-Pérez
T
Toby Collins
A
Adrien Bartoli
DOI:10.1109/ACCESS.2021.3082011delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Shape-from-Template (SfT) solves the registration and 3D reconstruction of a deformable 3D object, represented by the template, from a single image. Recently, methods based on deep learning have been able to solve SfT for the wide-baseline case in real-time, clearly surpassing classical methods. However, the main limitation of current methods is the need for fine tuning of the neural models to a specific geometry and appearance represented by the template texture map. We propose the first texture-generic deep learning SfT method which adapts to new texture maps at run-time, without the need for texture specific fine tuning. We achieve this by dividing the problem into a segmentation step and a registration and reconstruction step, both solved with deep learning. We include the template texture map as one of the neural inputs in both steps, training our models to adapt to different ones. We show that our method obtains comparable or better results to previous deep learning models, which are texture specific. It works in challenging imaging conditions, including complex deformations, occlusions, motion blur and poor textures. Our implementation runs in real-time, with a low-cost GPU and CPU.
Keyword:
Three-dimensional displays
Strain
Shape
Image reconstruction
Deformable models
Cameras
Solid modeling
Monocular
3D model
image registration
3D reconstruction
wide-baseline
dense
deformable reconstruction
shape-from-template
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
34.2W

机构

U
Universidad Rey Juan Carlos
学者数:
264
论文数: 118
被引数: 1.3K
U
Universidad de Alcalá
学者数:
182
论文数: 82
被引数: 1.6K
引用论文

引用论文

Judgment Capacity, Fear of Falling, and the Risk of Falls in Community-Dwelling Older Adults: The Progetto Veneto Anziani Longitudinal Study社区居住的老年人的判断能力,对跌倒的恐惧和跌倒的风险: Progetto Veneto Anziani纵向研究
err2020-06-01
err0
errOAAI
errCaterina Trevisan; Bruno M. Zanforlini; Stefania Maggi; Marianna Noale; Federica Limongi; Marina De Rui; Maria Chiara Corti; Egle Perissinotto; Anna-Karin Welmer; Enzo Manzato; Giuseppe Sergi
err分享
err收藏
On a mechanism of lubrication by adsorbed gases
errWear
IF0
err1990-10-01
err0
PREAI
errJ. Lepage; A. Mezin; R. Ramboarina
err分享
err收藏
Lentivirus-mediated down-regulation of CK2α inhibits proliferation and induces apoptosis of malignant lymphoma and leukemia cells
err2018-12-01
err0
PREAI
errLi Jiang; Jinghui Zhang; Naifeng Hu; Aichun Liu; Hailong Zhu; Lianqiao Li; Yuyang Tian; Xue Chen; Lina Quan
err分享
err收藏
Rab7b at the intersection of intracellular trafficking and cell migration
err2015-08-27
err0
errOAAI
errMarita Borg Distefano; Ingrid Kjos; Oddmund Bakke; Cinzia Progida
err分享
err收藏
Gradual and Acute Temperature Rise Induces Crossing Endocrine, Metabolic, and Immunological Pathways in Maraena Whitefish (Coregonus maraena)
err2018-07-19
err0
errOAAI
errAlexander Rebl; Marieke Verleih; Mareen Nipkow; Simone Altmann; Ralf Bochert; Tom Goldammer
err分享
err收藏
Advanced Vibrations
err
IF0
err2013-01-01
err0
PREAI
errReza N. Jazar
err分享
err收藏
学者 查看更多内容