arrow
返回

Pose-and-shear-based tactile servoing

delete2024-01-30
delete2
delete
OA
AI
J
John W. Lloyd
N
Nathan F. Lepora *
DOI:10.1177/02783649231225811delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Tactile servoing is an important technique because it enables robots to manipulate objects with precision and accuracy while adapting to changes in their environments in real-time. One approach for tactile servo control with high-resolution soft tactile sensors is to estimate the contact pose relative to an object surface using a convolutional neural network (CNN) for use as a feedback signal. In this paper, we investigate how the surface pose estimation model can be extended to include shear, and utilise these combined pose-and-shear models to develop a tactile robotic system that can be programmed for diverse non-prehensile manipulation tasks, such as object tracking, surface-following, single-arm object pushing and dual-arm object pushing. In doing this, two technical challenges had to be overcome. Firstly, the use of tactile data that includes shear-induced slippage can lead to error-prone estimates unsuitable for accurate control, and so we modified the CNN into a Gaussian-density neural network and used a discriminative Bayesian filter to improve the predictions with a state dynamics model that utilises the robot kinematics. Secondly, to achieve smooth robot motion in 3D space while interacting with objects, we used SE(3) velocity-based servo control, which required re-deriving the Bayesian filter update equations using Lie group theory, as many standard assumptions do not hold for state variables defined on non-Euclidean manifolds. In future, we believe that pose-and-shear-based tactile servoing will enable many object manipulation tasks and the fully-dexterous utilisation of multi-fingered tactile robot hands.
Keyword:
Tactile sensing
deep learning
Bayesian filtering
feedback control
tactile servoing
robotic pushing
object manipulation

期刊

International Journal of Robotics Research 封面图
International Journal of Robotics Research
IF:
5
论文数:
2.4K
被引数:
1.5W

机构

U
University of Bristol
学者数:
3.1W
论文数: 3.0W
被引数: 5.3W
引用论文

引用论文

err分享
err收藏
Presence of vasa vasorum in human intracranial aneurysms
err2020-07-22
err0
PREAI
errDingke Wen; Nicholas W. Kieran; Zhiyuan Yu; Xuyang Liu; Yue Xiao; Hao Li; Chao You; Mu Yang; Lu Ma
err分享
err收藏
Dynamic Trk and G Protein Signalings Regulate Dopaminergic Neurodifferentiation in Human Trophoblast Stem Cells
err2015-11-25
err0
errOAAI
errEing-Mei Tsai; Yu-Chih Wang; Tony Tung-Yin Lee; Cheng-Fang Tsai; Hung-Sheng Chen; Feng-Jie Lai; Kazunari K. Yokoyama; Tsung-Hsun Hsieh; Ruey-Meei Wu; Jau-nan Lee
err分享
err收藏
err分享
err收藏
In Vitro and In Silico Evaluations of Anti-Mycobacterium tuberculosis Activity of Benzohydrazones Compounds
err2021-11-01
err0
PREAI
errEloísa Gibin Sampiron; Giovana Ferreira Costacurta; Leonora Lacerda Calsavara; Vanessa Pietrowski Baldin; Gabrielle Vaz da Silva; Vanessa Guimarães Alves Olher; Lincoln Herholz Ferraretto; Katiany Rizzieri Caleffi-Ferraciolli; Rosilene Fressatti Cardoso; Vera Lucia Dias Siqueira; Fábio Vandresen; Regiane Bertin de Lima Scodro
err分享
err收藏
Characterization of venom components from the scorpion Androctonus crassicauda of Turkey: Peptides and genes
err2006-07-01
err0
PREAI
errFigen Caliskan; Blanca Ines García; Fredy I.V. Coronas; Cesar V.F. Batista; Fernando Z. Zamudio; Lourival D. Possani
err分享
err收藏
学者 查看更多内容