arrow
返回

DATR: Diffusion-Based 3D Apple Tree Reconstruction Framework With Sparse-View

delete2026-01-19
delete0
PRE
AI
A
Alan Zoubi
Y
Yiyuan Lin
R
Ruiming Du
L
L. K. Cheng
Y
Yu Jiang
DOI:10.1109/LRA.2026.3655283delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Digital twin applications offered transformative potential by enabling real-time monitoring and robotic simulation through accurate virtual replicas of physical assets. The key to these systems is 3D reconstruction with high geometrical fidelity. However, existing methods struggled under field conditions, especially with sparse and occluded views. This study developed the DATR framework for apple tree reconstruction from sparse views. DATR automatically generates tree masks from field images using onboard sensors and foundation models, which filter background information from multi-modal data for reconstruction. Leveraging the multi-modality, a diffusion model generates novel views and a large reconstruction model produces implicit neural fields. Geometric priors enable scale retrieval to align output with real-world dimensions. Both models were trained using realistic synthetic apple trees generated by a Real2Sim data generator. The framework was evaluated on both field and synthetic datasets. The field dataset includes six apple trees with field-measured ground truth, while the synthetic dataset featured structurally diverse trees. The evaluation results indicated that our DATR framework surpassed existing 3D reconstruction techniques on both datasets, providing a favorable balance of accuracy and efficiency. It achieved domain-trait estimation performance on par with industrial-grade stationary laser scanners, while increasing scan throughput by approximately 1000×, thereby underscoring its strong promise for scalable agricultural digital twin systems.
Keyword:
Digital twin
agricultural robotics
robot perception
few-shot 3D reconstruction
Real2Sim closed loop

期刊

I
IEEE Robotics and Automation Letters
IF:
5.3
论文数:
1.8K
被引数:
3.9W

机构

C
cornell university
学者数:
5.6K
论文数: 2.3K
被引数: 0
引用论文

引用论文

In-field apple size estimation using photogrammetry-derived 3D point clouds: Comparison of 4 different methods considering fruit occlusions
err2021-09-01
err49
errOAAI
errGene-Mola, Jordi; Sanz-Cortiella, Ricardo; Rosell-Polo, Joan R.; Escola, Alexandre; Gregorio, Eduard
err分享
err收藏
Instant-3D: Instant Neural Radiance Field Training Towards On-Device AR/VR 3D Reconstruction
err2023-06-17
err0
errOAAI
errSixu Li; Chaojian Li; Wenbo Zhu; Boyang (Tony) Yu; Yang (Katie) Zhao; Cheng Wan; Haoran You; Huihong Shi; Yingyan (Celine) Lin
err分享
err收藏
Deep learning based segmentation for automated training of apple trees on trellis wires
err2020-03-01
err102
errOAAI
errMajeed, Yaqoob; Zhang, Jing; Zhang, Xin; Fu, Longsheng; Karkee, Manoj; Zhang, Qin; Whiting, Matthew D.
err分享
err收藏
Zero-1-to-3: Zero-shot One Image to 3D Object零-1-to-3: 零拍摄一个图像到3D对象
err2023-10-01
err0
errOAAI
errRuoshi Liu; Rundi Wu; Basile Van Hoorick; Pavel Tokmakov; Sergey Zakharov; Carl Vondrick
err分享
err收藏
Efficient Geometry-aware 3D Generative Adversarial Networks
err2022-06-01
err0
errOAAI
errEric R. Chan; Connor Z. Lin; Matthew A. Chan; Koki Nagano; Boxiao Pan; Shalini de Mello; Orazio Gallo; Leonidas Guibas; Jonathan Tremblay; Sameh Khamis; Tero Karras; Gordon Wetzstein
err分享
err收藏
学者 查看更多内容