arrow
返回

A Self-Supervised Learning Solution With Momentum-Based Siamese Network for Robotic Visual Task

delete2023-01-01
delete0
delete
OA
AI
H
Huang, Yuehong *
Y
Yu‐Chee Tseng
DOI:10.1109/ACCESS.2023.3321276delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
How a robot induces causality, abstracts information from states, and plans for tasks are major challenges in artificial intelligence. However, habitually used deep reinforcement learning is not a cure-all solution. This study proposes MoSN, a momentum-based Siamese network for a robotic visual task. Instead of trying to learn representations that abstract all the variation factors of the environment as in most prior studies, MoSN labels its observations as their causes so that it can learn representations of visual states in a self-supervised manner. These representations are then used to enhance perceptual and cognitive abilities and to perform our robotic visual task when a robot takes over a new environment. In particular, this study proposes a momentum-based Siamese network with augmentation methods and a hybrid explicit contrastive loss to improve the combinatorial generalization capability of our model. We validate MoSN in real-world environments equipped with lights and light switches and attempt to derive the cause-and-effect relationship between switch states and visual states. MoSN is compared with previous methods in both static and dynamic environments with both fixed and dynamic viewing angles. MoSN outperforms previous methods in most cases.
Keyword:
Artificial intelligence
causality
cause-and-effect
momentum-based Siamese network
self-supervised

期刊

IEEE Access 封面图
IEEE Access
IF:
3.6
论文数:
9.8W
被引数:
29.4W

机构

N
National Yang Ming Chiao Tung University
学者数:
2.5W
论文数: 2.3W
被引数: 2.2W
引用论文

引用论文

Titanium ketimide complexes as α-olefin homo- and copolymerisation catalysts. X-ray diffraction structures of [TiCp′(NCtBu2)Cl2] (Cp′=Ind, Cp*)
err2004-01-01
err0
PREAI
errAlberto R. Dias; M. Teresa Duarte; Anabela C. Fernandes; Susete Fernandes; Maria M. Marques; Ana M. Martins; João F. da Silva; Sandra S. Rodrigues
err分享
err收藏
Causal reasoning in rats
errSCIENCE
IF45.8
err2006-02-17
err219
PREAI
errBlaisdell, AP; Sawa, K; Leising, KJ; Waldmann, MR
err分享
err收藏
err分享
err收藏
Learning Cooperative Personalized Policies from Gaze Data
err2019-10-17
err0
PREAI
errChristoph Gebhardt; Brian Hecox; Bas van Opheusden; Daniel Wigdor; James Hillis; Otmar Hilliges; Hrvoje Benko
err分享
err收藏
Toward Causal Representation Learning走向因果表示学习
err2021-05-01
err506
errOAAI
errSchoelkopf, Bernhard; Locatello, Francesco; Bauer, Stefan; Ke, Nan Rosemary; Kalchbrenner, Nal; Goyal, Anirudh; Bengio, Yoshua
err分享
err收藏
A Tough Call: Mitigating Advanced Code-Reuse Attacks at the Binary Level
err2016-05-01
err0
PREAI
errVictor van der Veen; Enes Goktas; Moritz Contag; Andre Pawoloski; Xi Chen; Sanjay Rawat; Herbert Bos; Thorsten Holz; Elias Athanasopoulos; Cristiano Giuffrida
err分享
err收藏
学者 查看更多内容