arrow
Return

Mastering percolation-like games with deep learning

delete2024-01-17
delete0
delete
OA
AI
M
Michael M. Danziger
O
Omkar R. Gojala
S
Sean P. Cornelius *
DOI:10.1103/PhysRevResearch.6.013067delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Though robustness of networks to random attacks has been widely studied, intentional destruction by an intelligent agent is not tractable with previous methods. Here we devise a single-player game on a lattice that mimics the logic of an attacker attempting to destroy a network. The objective of the game is to disable all nodes in the fewest number of steps. We develop a reinforcement learning approach using deep Q-learning that is capable of learning to play this game successfully, and in so doing, to optimally attack a network. Because the learning algorithm is universal, we train agents on different definitions of robustness and compare the learned strategies. We find that superficially similar definitions of robustness induce different strategies in the trained agent, implying that optimally attacking or defending a network is sensitive to the particular objective. Our method provides an approach to understand network robustness, with potential applications to other discrete processes in disordered systems.
Keywords:
FRACTAL DIMENSION
CLUSTER
NETWORK
INTERNET
GO

Journal

Physical Review Research cover
Physical Review Research
IF:
4.2
Papers:
7.6K
Citations:
2.7W

Organization

I
ibm israel
Scholars:
68
Papers: 44
Citations: 0
N
Northeastern University
Scholars:
2.4W
Papers: 1.5W
Citations: 3.0W
I
international business machines (ibm)
Scholars:
5.7K
Papers: 4.5K
Citations: 4
researcher View more organizations