.png){kind=icon}
返回
Adaptive Image-Based Visual Servoing Using Reinforcement Learning With Fuzzy State Coding
.png){kind=icon}
PRE
AI
DOI：10.1109/TFUZZ.2020.2991147.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Image-based visual servoing (IBVS) allows precise control of positioning and motion for relatively stationary targets using visual feedback. For IBVS, a mixture parameter beta allows better approximation of the image Jacobian matrix, which has a significant effect on the performance of IBVS. However, the setting for the mixture parameter depends on the camera's real-time posture; there is no clear way to define the change rules for most IBVS applications. Using simple model-free reinforcement learning, Q-learning, this article proposes a method to adaptively adjust the image Jacobian matrix for IBVS. If the state-space is discretized, traditional Q-learning encounters problems with the resolution that can cause sudden changes in the action, so the visual servoing system performs poorly. Besides, a robot in a real-world environment also cannot learn on as large a scale as virtual agents, so the efficiency with which agents learn must be increased. This article proposes a method that uses fuzzy state coding to accelerate learning during the training phase and to produce a smooth output in the application phase of the learning experience. A method that compensates for delay also allows more accurate extraction of features in a real environment. The results for simulation and experiment demonstrate that the proposed method performs better than other methods, in terms of learning speed, movement trajectory, and convergence time.
Keyword:
Delay compensation
fuzzy method
image-based visual servoing
image Jacobian matrix
mobile robot
reinforcement learning (RL)
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
11.9
论文数:
5.0K
被引数:
2.9W
机构
引用论文
.png){kind=icon}
Novel Position-Based Visual Servoing Approach to Robust Global Stability Under Field-of-View Constraint一种新的基于位置的视觉伺服方法，用于在视场约束下实现鲁棒的全局稳定性
PREAI
分享收藏分享收藏分享收藏On State Aggregation to Approximate Complex Value Functions in Large-Scale Markov Decision Processes
PREAI
分享收藏
查看更多内容