返回
Segmentation and motion parameter estimation for robotic Medjoul-date thinning
DOI:10.1007/s11119-021-09847-2.png)
摘要
En 中文
Laborious fruit thinning is required for attaining high-quality Medjoul dates. Thinning automation can significantly reduce labor and improve efficiency. An image processing apparatus developed for robotic Medjoul thinning is presented. Instance segmentation based on Mask R-CNN was applied to identify the fruit bunch components: spikelets and rachis. Motion planning parameters were extracted using the derived masks: rachis center point (RCP), rachis orientation angle, and spikelets remaining length. RCP and rachis orientation angle were computed geometrically, spikelets remaining length was estimated with a convolutional neural network (CNN) and a deep neural network (DNN). Instance segmentation results were accurate, especially for spikelets, for low intersection over union (IoU) (0.3 IoU, fruit determined for thinning identification, spikelets: 98%, rachises: 73%). However, only 66% of the rachises were correctly matched to spikelets. The segmentation of all spikelets and rachises in the images was of medium quality for low IoU (0.3 IoU, F1, spikelets: 0.67, rachis: 0.77), where both precision and recall dropped for higher IoUs. RCP and rachis orientation angle were accurately estimated (0.3 IoU, error, RCP: 2.2 cm, rachis orientation angle: 5.0 degrees). Spikelets remaining length estimation using CNN resulted in better performance than DNN (0.3 IoU, error, CNN: 19.7%, DNN: 24.6%). Spikelets segmentation results are suitable for thinning automation. However, rachis segmentation and matching the rachis and spikelets may still require human intervention during run-time. RCP and rachis orientation angle estimation errors are acceptable, while spikelets remaining length estimation errors are acceptable only for preliminary motion planning and mandate additional tuning during motion execution.
Keyword:
Thinning automation
Medjoul-dates
Deep neural networks
Image processing
期刊
IF:
6.6
论文数:
1.4K
被引数:
6.3K
机构
引用论文
IF0
Do Perceptions of Competence Mediate The Relationship Between Fundamental Motor Skill Proficiency and Physical Activity Levels of Children in Kindergarten?能力的感知是否可以介导幼儿园儿童的基本运动技能熟练程度与身体活动水平之间的关系?
Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning用于计算机辅助检测的深度卷积神经网络: CNN架构,数据集特征和迁移学习

