arrow
返回

Automatic penetration testing model based on reinforcement learning for complex network environments

delete2025-07-18
delete0
PRE
AI
Y
Yang Chen
J
Junjiang He
W
Wenbo Fang *
S
Shenwen Yang
J
Jiangchuan Chen
李
李涛 (Tao Li)
兰小龙 封面图
兰小龙 (Xiaolong Lan)
DOI:10.1007/s11227-025-07656-2delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
渗透测试是评估网络安全态势的有效方法。然而,随着网络攻击日益复杂和网络环境不断复杂化,传统的智能渗透测试模型在高效识别最优策略和实现快速收敛方面面临重大挑战。为解决这些问题,本文提出了一种基于强化学习的自动渗透测试模型,该模型将测试过程抽象为马尔可夫决策过程(MDP),并引入好奇心机制以增强探索效率。该方法的核心理念在于训练一个配备好奇心机制的强化学习算法代理,使其能够根据环境中的奖励反馈自动探索并选择最优渗透测试策略,并持续运行直至获取敏感权限。在包含50个主机和数百万状态的模拟网络环境中进行的实验表明,所提出的模型相比标准近端策略优化(PPO)算法,收敛时间减少了约50%。通过在高性能计算(HPC)框架内集成GPU加速并采用分布式并行处理,该模型有效满足了复杂网络环境下渗透测试的实时性和可扩展性要求。
Keyword:
Penetration testing
Reinforcement learning
Curiosity mechanism
HPC

期刊

Journal of Supercomputing 封面图
Journal of Supercomputing
IF:
2.7
论文数:
1.2K
被引数:
1.0W

机构

S
School of Cyber Science and Engineering
学者数:
200
论文数: 81
被引数: 0
引用论文

引用论文

Extending Attack Graphs to Represent Cyber-Attacks in Communication Protocols and Modern IT Networks
err2022-05-01
err26
errOAAI
errStan, Orly; Bitton, Ron; Ezrets, Michal; Dadon, Moran; Inokuchi, Masaki; Ohta, Yoshinobu; Yagyu, Tomohiko; Elovici, Yuval; Shabtai, Asaf
err分享
err收藏
A hierarchical deep reinforcement learning model with expert prior knowledge for intelligent penetration testing
err2023-09-01
err11
PREAI
errLi, Qianyu; Zhang, Min; Shen, Yi; Wang, Ruipeng; Hu, Miao; Li, Yang; Hao, Hao
err分享
err收藏
GAIL-PT: An intelligent penetration testing framework with generative adversarial imitation learning
err2023-03-01
err13
PREAI
errChen, Jinyin; Hu, Shulong; Zheng, Haibin; Xing, Changyou; Zhang, Guomin
err分享
err收藏
An Efficient Algorithm for Finding Modules in Fault Trees
err2021-09-01
err12
PREAI
errChen, Mei; Xiao, Ning-Cong; Zuo, Ming J.; Ding, Yi
err分享
err收藏
Cyborg Intelligence: Towards Bio-Machine Intelligent Systems INTRODUCTION
err2014-11-01
err6
errOAAI
errWu, Zhaohui; Pan, Gang; Principe, Jose C.; Cichocki, Andrzej
err分享
err收藏
Automated generation and analysis of attack graphs
err2024-11-19
err0
PREAI
errO. Sheyner; J. Haines; S. Jha; R. Lippmann; J.M. Wing
err分享
err收藏
学者 查看更多内容