arrow
Return

Developing a Cooking Robot System for Raw Food Processing Based on Instance Segmentation

delete2024-01-01
delete0
delete
OA
AI
K
Kyunghoon Jang
J
Jaeil Park
H
Hyeun Jeong Min *
DOI:10.1109/ACCESS.2024.3436849delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
This study presents an autonomous cooking robot system developed to improve culinary tasks through the classification and individual grasping of primary food materials. Our focus is on the recognition and manipulation of fried chicken parts and raw shrimp, which are essential in various culinary preparations, particularly frying. To distinguish and segment a specific target from a mix of similar objects, we utilize a Mask Region-based Convolutional Neural Network (Mask R-CNN) algorithm. Moreover, our robotic system incorporates a pose estimation technique to handle food materials of varying shapes. This system addresses the use of a direction vector transformed to determine 3D poses in real world, enabling a two-finger cooking robot to accurately grasp soft food materials. We have performed real robot experiments to demonstrate the system's ability to handle both fried chicken pieces and raw shrimp, verifying that our proposed method is effective. Additionally, we have confirmed the accuracy of our image segmentation approach.
Keywords:
Cooking robot
R-CNN
soft objects
food technology
hand robot
vision sensor
Cooking robot
R-CNN
soft objects
food technology
hand robot
vision sensor

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

A
Ajou University
Scholars:
1.1W
Papers: 1.0W
Citations: 8.9K