.png){kind=icon}
Return
Automatic penetration testing model based on reinforcement learning for complex network environments
.png){kind=icon}
PRE
AI
DOI：10.1007/s11227-025-07656-2.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
Penetration testing is an effective method for assessing cybersecurity posture. However, as cyber attacks become increasingly sophisticated and network environments grow in complexity, traditional intelligent penetration testing models encounter significant challenges in efficiently identifying optimal strategies and achieving rapid convergence. To address these issues, this paper proposes an automatic penetration testing model based on reinforcement learning, which abstracts the testing process as a Markov Decision Process (MDP) and incorporates a curiosity mechanism to enhance exploration efficiency. The core of this approach lies in training an agent using a reinforcement learning algorithm equipped with a curiosity mechanism, enabling it to automatically explore and select optimal penetration testing strategies based on reward feedback from the environment, and to persist until sensitive privileges are obtained. Experiments conducted in a simulated network environment with 50 hosts and millions of states demonstrate that the proposed model reduces convergence time by approximately 50% compared to the standard Proximal Policy Optimization (PPO) algorithm. By integrating GPU acceleration within a high-performance computing (HPC) framework and employing distributed parallel processing, the model effectively satisfies the real-time and scalability requirements of penetration testing in complex network environments.
Keywords:
Penetration testing
Reinforcement learning
Curiosity mechanism
HPC
Journal
IF:
2.7
Papers:
1.2K
Citations:
1.0W
Organization
Cited Papers
Extending Attack Graphs to Represent Cyber-Attacks in Communication Protocols and Modern IT Networks
OAAI
OAAIShareSaveA review of attack graph and attack tree visual syntax in cyber security.png)
COMPUTER SCIENCE REVIEW
OAAI
COMPUTER SCIENCE REVIEWIF12.7
OAAIShareSaveA hierarchical deep reinforcement learning model with expert prior knowledge for intelligent penetration testingCOMPUTERS & SECURITY
COMPUTERS & SECURITYIF5.4
PREAI
ShareSaveGAIL-PT: An intelligent penetration testing framework with generative adversarial imitation learningCOMPUTERS & SECURITY
COMPUTERS & SECURITYIF5.4
PREAI
ShareSaveShareSaveShareSave
View more