.png){kind=icon}
返回
Motion Recognition-Based Robot Arm Control System Using Head Mounted Display
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2020.2964801.png)
.png){kind=icon}
.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
This paper proposes a novel remote monitoring system using a head mounted display (HMD). By using an HMD, a high degree of immersion and the sense of reality is provided to the user. Further, it becomes more convenient to move the camera position while controlling the robot arm on which the camera is mounted through the coordinates obtained from the HMD sensors. The proposed system performs two tasks. Initially, in order to render images in the HMD, the camera captures input images, and the PC connected to the robot arm sends the image to the PC connected to the HMD in real-time after which the image is rendered in the HMD. For the real-time monitoring, we increased the frame per second by reducing the data size. In order to reduce the data size, we define region of interest which is the region a user can see. Then, region of interest of the image is cropped and the resolution of entire image is degraded. Therefore, two images composed of cropped image and degraded image are transmitted and merged into an image. In this way, we can reduce the data size and provide the user with monitoring the image of the original quality. Next, using the inertial measurement unit sensor and base station sensors built into the HMD, the user controls the displacement of the camera during rotation and translation by controlling the robot arm by the user's own motion. The PC connected to theHMDtransmits the motion coordinates of theHMDacquired from the sensor into the PC connected to the robot arm. To control the translation of the camera, we define a coordinate system that represents the y-axis as running from top to bottom, and the x-axis as running from the front to the back in three-dimensional space. Thus, each step motor along each axis, which controls the robot arm, has its movement controlled by supplying appropriate values of angular degrees. Through the above process, the proposed method implements a remote monitoring system with five degrees of freedom. In the experiment, we measured the data transmission delay time and the displacement error due to the robot arm's motion control to determine whether the system is suitable for a real-time remote monitoring system. Experimental results show that the proposed system can be optimally operated with a frame rate of 15 frames per second and a group of pixel resolutions of 640x640 of the cropped image and 240x120 of the degraded image. In addition, the average error rate of the robot arm's displacement was 6.45% when the camera position was controlled through the robot arm.
Keyword:
Head mounted display
real-time control
remote monitoring system
robot arm
AI总结
对已上传原文的论文进行重点信息的提取，主要内容包括：简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
引用论文
Software Defined Radio and Wireless Acoustic Networking for Amateur Drone Surveillance用于业余无人机监视的软件定义无线电和无线声学网络
PREAI
分享收藏Photosensor-Based Latency Measurement System for Head-Mounted Displays基于光电传感器的头戴式显示器延迟测量系统.png)
SENSORSOAAI
SENSORSIF3.5
OAAI分享收藏
查看更多内容