.png){kind=icon}
返回
Deep learning based robot cognitive architecture for collaborative assembly tasks
.png){kind=icon}
OA
AI
DOI：10.1016/j.rcim.2023.102572.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
As the manufacturing industry becomes more agile, the use of collaborative robots capable of safely working with humans is becoming more prevalent, while adaptable , natural interaction is a goal yet to be achieved. This work presents a cognitive architecture composed of perception and reasoning modules that allows a robot to adapt its actions while collaborating with humans in an assembly task. Human action recognition perception is performed using convolutional neural network models with inertial measurement unit and skeleton tracking data. The action predictions are used for task status reasoning which predicts the time left for each action in a task allowing a robot to plan future actions. The task status reasoning uses a recurrent neural network method which is developed for transferability to new actions and tasks. Updateable input parameters allowing the system to optimise for each user and task with each trial performed are also investigated. Finally, the complete system is demonstrated with the collaborative assembly of a small chair and wooden box, along with a solo robot task of stacking objects performed when it would otherwise be idle. The human actions recognised are using a screw driver, Allen key, hammer and hand screwing, with online accuracies between 83-92%. User trials demonstrate the robot deciding when to start collaborative actions in order to synchronise with the user, as well as deciding when it has time to complete an action on its solo task before a collaborative action is required.
Keyword:
Human-robot collaboration
Deep learning
Industry 4
0
Human action recognition
期刊
R
IF:
11.4
论文数:
3.3K
被引数:
1.3W
机构
引用论文
A fusion-based spiking neural network approach for predicting collaboration request in human-robot collaboration基于融合的脉冲神经网络预测人机协作中的协作请求
PREAI
分享收藏Elevated plasma angiotensin converting enzyme 2 activity is an independent predictor of major adverse cardiac events in patients with obstructive coronary artery disease.png)
PLOS ONE
OAAI
PLOS ONEIF0
OAAI分享收藏
查看更多内容