arrow
返回

Semantic Segmentation Method for High-Resolution Tomato Seedling Point Clouds Based on Sparse Convolution

delete2024-12-31
delete0
delete
OA
AI
L
Li, Shizhao
Z
Zhichao Yan
B
Boxiang Ma
S
Shaoru Guo *
宋红霞 封面图
宋红霞 (Hongxia Song)
DOI:10.3390/agriculture15010074delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Semantic segmentation of three-dimensional (3D) plant point clouds at the stem-leaf level is foundational and indispensable for high-throughput tomato phenotyping systems. However, existing semantic segmentation methods often suffer from issues such as low precision and slow inference speed. To address these challenges, we propose an innovative encoding-decoding structure, incorporating voxel sparse convolution (SpConv) and attention-based feature fusion (VSCAFF) to enhance semantic segmentation of the point clouds of high-resolution tomato seedling images. Tomato seedling point clouds from the Pheno4D dataset labeled into semantic classes of 'leaf', 'stem', and 'soil' are applied for the semantic segmentation. In order to reduce the number of parameters so as to further improve the inference speed, the SpConv module is designed to function through the residual concatenation of the skeleton convolution kernel and the regular convolution kernel. The feature fusion module based on the attention mechanism is designed by giving the corresponding attention weights to the voxel diffusion features and the point features in order to avoid the ambiguity of points with different semantics having the same characteristics caused by the diffusion module, in addition to suppressing noise. Finally, to solve model training class bias caused by the uneven distribution of point cloud classes, the composite loss function of Lov & aacute;sz-Softmax and weighted cross-entropy is introduced to supervise the model training and improve its performance. The results show that mIoU of VSCAFF is 86.96%, which outperformed the performance of PointNet, PointNet++, and DGCNN, respectively. IoU of VSCAFF achieves 99.63% in the soil class, 64.47% in the stem class, and 96.72% in the leaf class. The time delay of 35ms in inference speed is better than PointNet++ and DGCNN. The results demonstrate that VSCAFF has high performance and inference speed for semantic segmentation of high-resolution tomato point clouds, and can provide technical support for the high-throughput automatic phenotypic analysis of tomato plants.
Keyword:
3D point clouds
semantic segmentation
tomato
sparse convolution

期刊

Agriculture 封面图
Agriculture
IF:
3.6
论文数:
1.3W
被引数:
2.8W

机构

S
Shanxi Agricultural University
学者数:
9.4K
论文数: 3.6K
被引数: 3.8K
S
Shanxi University
学者数:
1.3W
论文数: 8.4K
被引数: 1.2W
引用论文

引用论文

Evaluation of Wheat Genotypes under Water Regimes Using Hyperspectral Reflectance and Agro-Physiological Parameters via Genotype by Yield*Trait Approaches in Sakha Station, Delta, Egypt
err2023-06-30
err6
errOAAI
errDarwish, Mohamed A.; Elkot, Ahmed F.; Elfanah, Ahmed M. S.; Selim, Adel I.; Yassin, Mohamed M. M.; Abomarzoka, Elsayed A.; El-Maghraby, Maher A.; Rebouh, Nazih Y.; Ali, Abdelraouf M.
err分享
err收藏
Soybean-MVS: Annotated Three-Dimensional Model Dataset of Whole Growth Period Soybeans for 3D Plant Organ Segmentation
err2023-06-28
err14
errOAAI
errSun, Yongzhe; Zhang, Zhixin; Sun, Kai; Li, Shuai; Yu, Jianglin; Miao, Linxiao; Zhang, Zhanguo; Li, Yang; Zhao, Hongjie; Hu, Zhenbang; Xin, Dawei; Chen, Qingshan; Zhu, Rongsheng
err分享
err收藏
A Comprehensive Survey of Image Augmentation Techniques for Deep Learning
err2023-05-01
err176
errOAAI
errXu, Mingle; Yoon, Sook; Fuentes, Alvaro; Park, Dong Sun
err分享
err收藏
Tomato recognition and location algorithm based on improved YOLOv5
err2023-05-01
err35
PREAI
errLi, Tianhua; Sun, Meng; He, Qinghai; Zhang, Guanshan; Shi, Guoying; Ding, Xiaoming; Lin, Sen
err分享
err收藏
err分享
err收藏
学者 查看更多内容