.png){kind=icon}
返回
Vision-based interaction force estimation for robot grip motion without tactile/force sensor
.png){kind=icon}
PRE
AI
DOI：10.1016/j.eswa.2022.118441.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Humans perceive an interaction force through the kinesthetic sense or tactile sense. When viewing the image, they estimate the interaction force on the basis of pseudo-haptics. The interaction force of a robot is traditionally measured using a contact-type tactile sensor or a force/torque (F/T) sensor. In this work, we propose a method for estimating the interaction force between a robot and objects during grasping and picking. The method is based on images, without involving an F/T sensor or a tactile sensor. For undeformable objects, more precise force estimation was achieved by simultaneously using RGB and depth images, the robot position, and electrical current. We propose a deep neural network structure that combines DenseNet and a Transformer encoder/ decoder for predicting the interaction force. We verified proposed network with generated DB which has recorded the interaction with 41 objects. Additionally, we compared the results with changing the inputs of the network. Our model could estimate the interaction force from various input modalities for both known objects and unseen objects during its training. The results clearly indicate that the proposed method produces the best results compared with other models, with less than 3% error in estimating the interaction force.
Keyword:
Force estimation
Robot grasping
Interaction force
Machine learning
期刊
IF:
7.5
论文数:
3.0W
被引数:
10.2W
机构
引用论文
Flexible Multimodal Sensors for Electronic Skin: Principle, Materials, Device, Array Architecture, and Data Acquisition Method用于电子皮肤的柔性多模式传感器: 原理，材料，设备，阵列架构和数据采集方法.png)
PROCEEDINGS OF THE IEEE
PROCEEDINGS OF THE IEEEIF25.9
PREAI
分享收藏A Sensorless Hand Guiding Scheme Based on Model Identification and Control for Industrial Robot
PREAI
分享收藏Optical Chemical Sensor Using Intensity Ratiometric Fluorescence Signals for Fast and Reliable pH DeterminationACS Sensors
ACS SensorsIF0
PREAI
分享收藏GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and ForceGelSight: 用于估计几何形状和力的高分辨率机器人触觉传感器SENSORS
OAAI
SENSORSIF3.5
OAAI分享收藏A recurrent convolutional neural network approach for sensorless force estimation in robotic surgeryOAAI
OAAI分享收藏
查看更多内容