Map modeling for full body gesture using flex sensor and machine learning algorithms

Arash Hekmat

doi:10.1007/s00530-022-00946-2

2022-06-13

PRE

Arash Hekmat

Zuping Zhang *

Hashim Saleh Sharaf Al-deen

DOI：10.1007/s00530-022-00946-2

原文链接

原文求助

摘要

En 中文

This study investigates how we can provide a database map model for full-body gestures by utilizing the hierarchical nested set model and its features to cover all aspects of existing gestures and motions. A mapping model allows us to execute any appropriate gesture pattern for each motion state via a hierarchically nested set tracking feature that executes at a varied speed or time. The nested set model allows us to distinguish each node location with its right and left values, which aids us in controlling the power to motors at a certain time and speed while taking data quantity into account by eliminating the time and interaction data for speed and motor management. The main issue in this study is that instead of reprocessing data for each movement change, machine learning methods are used to create a map model from classified data. This paper discusses the connection between sensors and databases for exchanging data models in the form of a map that may be used to interact between different positions of the robot's parts based on sensor data. For example, suppose a robot falls down and the sensors such as the gyroscope, accelerometers, touch sensor, camera (image processing), or voice recognition are set as an input command to understand the current position. Then, using artificial modeling in our database, we can control the robot to return to the standard position, such as standing up on its legs. We used motion flex sensor gloves to record all gestures at varied motion speeds and execution durations, and then we ran three different classification algorithms on the recorded data to achieve the best data categorization. Finally, based on a nested set model for the whole body, we provided a database map with those classified data gathered from the sensor, and as a consequence, we made a comparison with parent and child categorization to highlight the complexity and data collection differences between these two techniques.

Keyword:

Body gesture recognition

Gesture pattern

Map model

Hierarchical nested set