arrow
返回

Segmentation and motion parameter estimation for robotic Medjoul-date thinning

delete2021-09-07
delete7
PRE
AI
T
Tal Shoshan
A
Avital Bechar
Y
Yuval Cohen
A
A. Sadowsky
S
Sigal Berman *
DOI:10.1007/s11119-021-09847-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Laborious fruit thinning is required for attaining high-quality Medjoul dates. Thinning automation can significantly reduce labor and improve efficiency. An image processing apparatus developed for robotic Medjoul thinning is presented. Instance segmentation based on Mask R-CNN was applied to identify the fruit bunch components: spikelets and rachis. Motion planning parameters were extracted using the derived masks: rachis center point (RCP), rachis orientation angle, and spikelets remaining length. RCP and rachis orientation angle were computed geometrically, spikelets remaining length was estimated with a convolutional neural network (CNN) and a deep neural network (DNN). Instance segmentation results were accurate, especially for spikelets, for low intersection over union (IoU) (0.3 IoU, fruit determined for thinning identification, spikelets: 98%, rachises: 73%). However, only 66% of the rachises were correctly matched to spikelets. The segmentation of all spikelets and rachises in the images was of medium quality for low IoU (0.3 IoU, F1, spikelets: 0.67, rachis: 0.77), where both precision and recall dropped for higher IoUs. RCP and rachis orientation angle were accurately estimated (0.3 IoU, error, RCP: 2.2 cm, rachis orientation angle: 5.0 degrees). Spikelets remaining length estimation using CNN resulted in better performance than DNN (0.3 IoU, error, CNN: 19.7%, DNN: 24.6%). Spikelets segmentation results are suitable for thinning automation. However, rachis segmentation and matching the rachis and spikelets may still require human intervention during run-time. RCP and rachis orientation angle estimation errors are acceptable, while spikelets remaining length estimation errors are acceptable only for preliminary motion planning and mandate additional tuning during motion execution.
Keyword:
Thinning automation
Medjoul-dates
Deep neural networks
Image processing

期刊

Precision Agriculture 封面图
Precision Agriculture
IF:
6.6
论文数:
1.4K
被引数:
6.3K

机构

B
ben gurion university
学者数:
1.3W
论文数: 1.0W
被引数: 5
V
volcani institute of agricultural research
学者数:
3.2K
论文数: 2.5K
被引数: 7
引用论文

引用论文

err2002-01-01
err0
PREAI
errAbu Sayed Md Kamal; Preeda Parkpian
err分享
err收藏
Energy management and economic analysis of multiple energy storage systems in solar PV/PEMFC hybrid power systems
err2020-11-02
err0
errOAAI
errVipin Das; Asheesh K. Singh; PitchaiVijaya Karuppanan; Pradeep Kumar; Sri Niwas Singh; Vassilios Georgios Agelidis
err分享
err收藏
err分享
err收藏
Grape detection, segmentation, and tracking using deep neural networks and three-dimensional association
err2020-03-01
err206
errOAAI
errSantos, Thiago T.; de Souza, Leonardo L.; dos Santos, Andreza A.; Avila, Sandra
err分享
err收藏
err分享
err收藏
学者 查看更多内容