arrow
Return

Maize stem-leaf segmentation framework based on deformable point clouds

delete2024-05-01
delete2
PRE
AI
Y
Yang, Xin
苗腾 (Miao, Teng)
X
Xueying Tian
W
Wang, Dabao
J
Jianxiang Zhao
L
Lin, Lili
Z
Zhu, Chao
Y
Yang, Tao
X
Xu, Tongyu *
DOI:10.1016/j.isprsjprs.2024.03.025delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The efficacy of three-dimensional (3D) point clouds in studying crop morphological structures is based on their direct and accurate data presentation ability. With deep-learning integration, organ segmentation from point clouds could serve as the basis for tremendous advancements in organ-level phenotyping. However, despite the potential, the acquisition of a sufficient number of annotated plant point clouds for practical model training remains a major hurdle. To help overcome this limitation, we constructed a 3D point-cloud dataset specifically for maize stem-leaf segmentation encompassing 428 maize plants ranging from 2 to 12 leaves. We also developed a point cloud enhancement strategy that uses highly controllable deformations to improve the morphological diversity of the training set significantly, while preserving the local geometric features of organs. Our dataset supports the generation of abundant training data from a limited number of labelled data, and we also provide a segmentation framework based on the augmented data to validate the efficiency of our enhancement technique. Two labelled data items were randomly chosen from our plant dataset based on every leaf number, yielding 22 labelled data items total, to produce several deformed point clouds for training the PointNet++ semantic segmentation model, as well as the hierarchical aggregation for the 3D instant segmentation (HAIS) model. These models were tested on 406 datasets, where the PointNet++ model secured a 91.93 % mean intersection-over-union (mIoU) in semantic segmentation and the HAIS model obtained an 89.57 % mean average precision (mAP) in instance segmentation. Following post-processing, an instance segmentation result of 93.74 % mAP was achieved with the HAIS model. These findings demonstrate that our method allows for the efficient training of organ segmentation models with minimal labelled data input in a reduced timeframe. Moreover, it offers an effective tool for point-cloud parsing in maize phenotyping research.
Keywords:
Maize Point Cloud Dataset
Physically based deformation
Point Cloud Data Augmentation
Stem-Leaf Segmentation

Journal

ISPRS Journal of Photogrammetry and Remote Sensing cover
ISPRS Journal of Photogrammetry and Remote Sensing
IF:
12.2
Papers:
4.4K
Citations:
3.2W

Organization

U
University of Sanya
Scholars:
190
Papers: 162
Citations: 1
Z
Zhejiang A&F University
Scholars:
1.0W
Papers: 6.1K
Citations: 178
S
Shenyang Agricultural University
Scholars:
9.0K
Papers: 4.3K
Citations: 18
researcher View more organizations
Cited Papers

Cited Papers

The frequency of selective IgA deficiency in myasthenia gravis
err1992-03-01
err0
PREAI
errR. Liblau; A-M. Fischer; D. E. Shapiro; E. Morel; J-F. Bach
errShare
errSave
PlantNet: A dual-function point cloud segmentation network for multiple plant species
err2022-02-01
err65
PREAI
errLi, Dawei; Shi, Guoliang; Li, Jinsheng; Chen, Yingliang; Zhang, Songyin; Xiang, Shiyu; Jin, Shichao
errShare
errSave
Automated morphological traits extraction for sorghum plants via 3D point cloud data analysis
err2019-07-01
err64
errOAAI
errXiang, Lirong; Bao, Yin; Tang, Lie; Ortiz, Diego; Salas-Fernandez, Maria G.
errShare
errSave
3D model processing for high throughput phenotype extraction - the case of corn
err2020-05-01
err56
PREAI
errZermas, Dimitris; Morellas, Vassilios; Mulla, David; Papanikolopoulos, Nikos
errShare
errSave
Soybean-MVS: Annotated Three-Dimensional Model Dataset of Whole Growth Period Soybeans for 3D Plant Organ Segmentation
err2023-06-28
err14
errOAAI
errSun, Yongzhe; Zhang, Zhixin; Sun, Kai; Li, Shuai; Yu, Jianglin; Miao, Linxiao; Zhang, Zhanguo; Li, Yang; Zhao, Hongjie; Hu, Zhenbang; Xin, Dawei; Chen, Qingshan; Zhu, Rongsheng
errShare
errSave
errShare
errSave
Changes of rivers and lakes water quality in Lake Ebinur Basin, Xinjiang(2005-2020)
err2022-01-01
err0
errOAAI
errZhang Fei; Wang Weiwei; Xin Hongyun; Hao Jinxin; Liu Changjiang; Duan Pan
errShare
errSave
Eff-3DPSeg: 3D Organ-Level Plant Shoot Segmentation Using Annotation-Efficient Deep Learning
err2023-01-01
err8
errOAAI
errLuo, Liyi; Jiang, Xintong; Yang, Yu; Samy, Eugene Roy Antony; Lefsrud, Mark; Hoyos-Villegas, Valerio; Sun, Shangpeng
errShare
errSave
researcher View more