.png){kind=icon}
返回
Weakly-Supervised Deep Shape-From-Template
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2025.3534271.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
We propose WS-DeepSfT, a novel deep learning-based approach to the Shape-from-Template (SfT) problem, which aims at reconstructing the 3D shape of a deformable object from a single RGB image and a template. WS-DeepSfT addresses the limitations of existing SfT techniques by combining a weakly-supervised deep neural network (DNN) for registration and a classical As-Rigid-As-Possible (ARAP) algorithm for 3D reconstruction. Unlike previous deep learning-based SfT methods, which require extensive synthetic data and depth sensors for training, WS-DeepSfT only requires regular RGB video of the deforming object and a segmentation mask to discriminate the object from the background. The registration model is trained without synthetic data, using videos where the object undergoes deformations, while ARAP does not require training and infers the 3D shape in real-time with minimal overhead. We show that WS-DeepSfT outperforms the state-of-the-art, in both accuracy and robustness, without requiring depth sensors or synthetic data generation. WS-DeepSfT thus offers a robust, efficient, and scalable approach to SfT, bringing it closer to applications such as augmented reality.
Keyword:
Deformation
Three-dimensional displays
Image reconstruction
Deformable models
Shape
Accuracy
Training
Synthetic data
Real-time systems
Sensors
Non-rigid
Shape-from-Template
weak-supervision
registration
wide-baseline
template-based
3D reconstruction
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
分享收藏AutoMorph: Automated Retinal Vascular Morphology Quantification Via a Deep Learning PipelineAutoMorph: 通过深度学习管道自动量化视网膜血管形态OAAI
OAAI分享收藏Electrochemically assisted micro localized grafting of aptamers in a microchannel engraved in fluorinated thermoplastic polymer Dyneon THV.png)
RSC Advances
RSC AdvancesIF0
PREAI
分享收藏
查看更多内容