arrow
返回

An interactive gesture control system for collaborative manipulator based on Leap Motion Controller

delete2024-05-28
delete0
delete
OA
AI
Y
Yunhan Li *
J
Jingjing Lou
Z
Zhiduan Cai
P
Pengfei Zheng
H
Haijun Wu
王
王晓笋 (Xiaosun Wang)
DOI:10.1177/16878132241253101delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Gesture control is often used for the control of robotic manipulators. However conventional methods always focus on position control of robotic manipulators and use a fixed position to place gesture detection devices, which limits the flexibility to control and interact. This paper presents an interactive gesture control system based on Leap Motion Controller that can overcome these shortcomings. A coordinate transformation is performed between the position of the left palm detected by Leap Motion Controller and the tool center point (TCP) of the collaborative manipulator to obtain gesture data first. This gesture data is used to control the posture of a six-joint collaborative manipulator-Lite6. The position of gripper is controlled by grip level of the right palm. A controller is designed to manipulate a lift table on which Leap Motion Controller is placed to achieve adaptive ascending and descending movements to meet the needs of operators of different heights and arm spans. A modified Kalman filter is used to filter noise and smooth the signal captured by Leap Motion Controller. The experiments demonstrate that the system can operate stably and accurately control the position, posture, and gripper position of a collaborative manipulator in real time using human palms' gestures.
Keyword:
Gesture control
collaborative manipulator
Leap Motion Controller
coordinate transformation
filter

期刊

Advances in Mechanical Engineering 封面图
Advances in Mechanical Engineering
IF:
2
论文数:
249
被引数:
9.5K

机构

Z
zhejiang university
学者数:
17.7W
论文数: 12.1W
被引数: 152
引用论文

引用论文

Power Management in Low-Power MCUs for Energy IoT Applications
errsensors
IF1.1
err2020-12-14
err4
errOAAI
errLin, Ling; Tang, Zhong; Tan, Nianxiong; Xiao, Xiaohui
err分享
err收藏
err分享
err收藏
err分享
err收藏
A Wearable Force Myography-Based Armband for Recognition of Upper Limb Gestures
errSENSORS
IF3.5
err2023-11-23
err5
errOAAI
errRehman, Mustafa Ur; Shah, Kamran; Ul Haq, Izhar; Iqbal, Sajid; Ismail, Mohamed A.
err分享
err收藏
Theory for light emission from a scanning tunneling microscope
err1990-11-15
err0
PREAI
errPeter Johansson; R. Monreal; Peter Apell
err分享
err收藏
学者 查看更多内容