arrow
返回

Reconstruction of Colored Soft Deformable Objects Based on Self-Generated Template

delete2022-02-01
delete2
PRE
AI
李
李基拓 (Jituo Li) *
刘鑫琦 封面图
刘鑫琦 (Xinqi Liu)
H
Haijing Deng
王
王天巍 (Tianwei Wang)
陆
陆国栋 (Guodong Lu)
J
Jin Wang
DOI:10.1016/j.cad.2021.103124delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
In reconstructing soft objects under different deformation states with RGB-D sensors, the results usually suffer from incomplete geometries and textures due to self-occlusion, such as dynamic wrinkles on a garment. A priori template is usually used for addressing this issue, but it requires complex scanning and an elaborate setup. This paper proposes a new framework to reconstruct a deformable soft object with complete geometry and consistent texture by introducing an incremental-completion self-generated template (SGT). By building a non-rigid registration that combines geometry and optical flow features, the SGT is dynamically updated and completed by supplementing the information from each initial state model. Then the updated SGT is reversely deformed to each state to obtain a sequence of dynamic reconstructed results with consistent geometry. Furthermore, a consistent Markov random field is also proposed to constrain mesh models in different states to generate consistent texture and guide non-rigid deformation. Experimental results show that our method achieves multi-state high -quality reconstruction effects, which provides a new solution for dynamically reconstructing colored soft objects. (c) 2021 Elsevier Ltd. All rights reserved.
Keyword:
3D reconstruction
Soft objects
Self-generated template
Non-rigid registration
Texture

期刊

C
Computer-Aided Design
IF:
3.1
论文数:
3.2K
被引数:
6.4K

机构

Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

Metric Regression Forests for Correspondence Estimation
err2015-04-11
err38
PREAI
errPons-Moll, Gerard; Taylor, Jonathan; Shotton, Jamie; Hertzmann, Aaron; Fitzgibbon, Andrew
err分享
err收藏
ElasticFusion: Real-time dense SLAM and light source estimation
err2016-09-30
err509
errOAAI
errWhelan, Thomas; Salas-Moreno, Renato F.; Glocker, Ben; Davison, Andrew J.; Leutenegger, Stefan
err分享
err收藏
ABF++:: Fast and robust angle based flattening
err2005-04-01
err262
errOAAI
errSheffer, A; Lévy, B; Mogilnitsky, M; Bogomyakov, A
err分享
err收藏
Fusion4D: Real-time Performance Capture of Challenging Scenes
err2016-07-11
err336
errOAAI
errDou, Mingsong; Kowdle, Adarsh; Khamis, Sameh; Escolano, Sergio Orts; Kohli, Pushmeet; Degtyarev, Yury; Rhemann, Christoph; Tankovich, Vladimir; Davidson, Philip; Kim, David; Izadi, Shahram; Fanello, Sean Ryan; Taylor, Jonathan
err分享
err收藏
Mitochondrial Fission in Human Diseases
err2017-01-01
err0
errOAAI
errMadhavika N. Serasinghe; Jerry E. Chipuk
err分享
err收藏
Shading-based Refinement on Volumetric Signed Distance Functions
err2015-07-27
err99
errOAAI
errZollhoefer, Michael; Dai, Angela; Innmann, Matthias; Wu, Chenglei; Stamminger, Marc; Theobalt, Christian; Niessner, Matthias
err分享
err收藏
OctoMap: an efficient probabilistic 3D mapping framework based on octreesOctoMap: 一种基于八叉树的高效概率三维映射框架
err2013-02-07
err2.1K
errOAAI
errHornung, Armin; Wurm, Kai M.; Bennewitz, Maren; Stachniss, Cyrill; Burgard, Wolfram
err分享
err收藏
Realtime Facial Animation with On-the-fly Correctives
err2013-07-21
err64
errOAAI
errLi, Hao; Yu, Jihun; Ye, Yuting; Bregler, Chris
err分享
err收藏
Real-time large-scale dense RGB-D SLAM with volumetric fusion具有体积融合的实时大规模密集rgb-d SLAM
err2014-12-09
err337
errOAAI
errWhelan, Thomas; Kaess, Michael; Johannsson, Hordur; Fallon, Maurice; Leonard, John J.; McDonald, John
err分享
err收藏
学者 查看更多内容