.png){kind=icon}
返回
Research on Apple Recognition and Localization Method Based on Deep Learning
.png){kind=icon}
OA
AI
DOI：10.3390/agronomy15020413.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
The development of robotic systems for apple picking is indeed a crucial advancement in agricultural technology, particularly in light of the ongoing labor shortages and the continuous evolution of automation technologies. Currently, during apple picking in complex environments, it is difficult to classify and identify the growth pattern of an apple and obtain information on its attitude synchronously. In this paper, through the integration of deep learning and stereo vision technology, the growth pattern and attitude of apples in the natural environment are identified, and three-dimensional spatial positioning is realized. This study proposes a fusion recognition method based on improved YOLOv7 for apple growth morphology classification and fruit position. Firstly, the multi-scale feature fusion network is improved by adding a 160 x 160 feature scale layer in the backbone network, which is used to enhance the model's sensitivity in the recognition of very small local features. Secondly, the CBAM attention mechanism is introduced to improve the network's attention to the target region of interest of the input image. Finally, the Soft-NMS algorithm is adopted, which can effectively prevent high-density overlapping targets from being suppressed at one time and thus prevent the occurrence of missed detection. In addition, the UNet segmentation network and the minimum outer circle and rectangle features are combined to obtain the unobstructed apple position. A depth image of the apple is obtained using an RGB-D camera, and the 3D coordinates of the apple picking point are obtained by combining the 2D coordinates in the RGB image with the depth value. The experimental results show that the recognition accuracy, recall and average recognition precision of the improved YOLOv7 are 86.9%, 80.5% and 87.1%, respectively, which are 4.2, 2.2 and 3.7 percentage points higher compared to the original YOLOv7 model; in addition, the average angular error of the apple position detection method is 3.964 degrees, with an accuracy of 94%, and the error in the three-dimensional coordinate positioning of the apple is within the range of 0.01 mm-1.53 mm, which can meet the demands of apple-picking system operation. The deep-learning-based stereo vision system constructed herein for apple picking robots can effectively identify and locate apples and meet the vision system requirements for the automated picking task performed by an apple-picking robot, with a view to laying the foundation for lossless and efficient apple picking.
Keyword:
apple picking
deep learning
position recognition
localization
期刊
A
IF:
3.4
论文数:
1.7W
被引数:
5.0W
机构
引用论文
Caw’s Walking State Recognition Based on Accelerometers and Gyroscopes Installed on Ear-Tags and Collar-Tags基于安装在耳标和项圈上的加速度计和陀螺仪的Caw步行状态识别
PREAI
分享收藏The Epidemiological and Clinical Characteristics of Hand, Foot, and Mouth Disease in Hangzhou, China, 2016 to 20182016 2018年杭州市手足口病的流行病学和临床特征OAAI
OAAI分享收藏Distant regulatory elements in a Sox10‐βGEO BAC transgene are required for expression of Sox10 in the enteric nervous system and other neural crest‐derived tissuesSox10-βgeo BAC转基因中的远距离调控元件是肠神经系统和其他神经源性组织中 Sox10 表达所必需的
OAAI
OAAI分享收藏Multi-Feature Patch-Based Segmentation Technique in the Gray-Centered RGB Color Space for Improved Apple Target Recognition.png)
AGRICULTURE-BASELOAAI
AGRICULTURE-BASELIF3.6
OAAI分享收藏
查看更多内容