arrow
Return

Influence Maximization in Complex Networks by Using Evolutionary Deep Reinforcement Learning

delete2023-08-01
delete31
delete
OA
AI
L
Lijia Ma
X
Xiaocong Li
林秋镇 (Qiuzhen Lin) *
李坚强 cover
李坚强 (Jianqiang Li)
V
Victor C. M. Leung
A
Asoke K. Nandi
DOI:10.1109/TETCI.2021.3136643delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Influence maximization (IM) in complex networks tries to activate a small subset of seed nodes that could maximize the propagation of influence. The studies on IM have attracted much attention due to their wide applications such as item recommendation, viral marketing, information propagation and disease immunization. Existing works mainly model the IM problem as a discrete optimization problem, and use either approximate or meta-heuristic algorithms to address this problem. However, these works are hard to find a good tradeoff between effectiveness and efficiency due to the NP-hard and large-scale network properties of the IM problem. In this article, we propose an evolutionary deep reinforcement learning algorithm (called EDRL-IM) for IM in complex networks. First, EDRL-IM models the IM problem as a continuous weight parameter optimization of deep Q network (DQN). Then, it combines an evolutionary algorithm (EA) and a deep reinforcement learning algorithm (DRL) to evolve the DQN. The EA simultaneously evolves a population of individuals, and each of which represents a possible DQN and returns a solution to the IM problem through a dynamic markov node selection strategy, while the DRL integrates all information and network-specific knowledge of DQNs to accelerate their evolution. Systematic experiments on both benchmark and real-world networks show the superiority of EDRL-IM over the state-of-the-art IM methods in finding seed nodes.
Keywords:
Optimization
Integrated circuit modeling
Complex networks
Computational modeling
Approximation algorithms
Reinforcement learning
Metaheuristics
Complex networks
influence maximization
deep reinforcement learning
evolutionary algorithm
optimization

Journal

I
IEEE Transactions on Emerging Topics in Computational Intelligence
IF:
6.5
Papers:
1.4K
Citations:
4.5K

Organization

B
brunel university
Scholars:
5.8K
Papers: 7.1K
Citations: 9
S
shenzhen university
Scholars:
4.5W
Papers: 3.4W
Citations: 72