arrow
Return

Generative Pre-Trained Transformer-Based Reinforcement Learning for Testing Web Application Firewalls

delete2024-01-01
delete5
PRE
AI
H
Hongliang Liang
李翔宇 (Xiangyu Li)
D
Da Xiao *
刘杰 (Jie Liu)
Y
Yanjie Zhou
J
Jin Li
DOI:10.1109/TDSC.2023.3252523delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Web Application Firewalls (WAFs) are widely deployed to protect key web applications against multiple security threats, so it is important to test WAFs regularly to prevent attackers from bypassing them easily. Machine-learning-based black-box WAF testing is gaining more attention, though existing learning-based approaches have strict requirements on the source and scale of payload data and suffer from the local optimum problem, limiting their effectiveness and practical application. We propose GPTFuzzer, a practical and effective generation-based approach to test WAFs by generating attack payloads token-by-token. Specifically, we fine-tune a Generative Pre-trained Transformer language model with reinforcement learning to make GPTFuzzer have the least restrictions on payload data and thus more applicable in practice, and we use reward modeling and KL-divergence penalty to improve the effectiveness of our approach and mitigate the local optimum issue. We implement GPTFuzzer and evaluate it on two well-known open-source WAFs against three kinds of common attacks. Experimental results show that GPTFuzzer significantly outperforms state-of-the-art approaches, i.e., ML-Driven and RAT, finding up to 7.8x (3.2x on average) more bypassing payloads within 1,250,000 requests, or finding out all bypassing payloads using up to 8.1x (3.3x on average) fewer requests.
Keywords:
Payloads
Grammar
Testing
Reinforcement learning
Data models
Adaptation models
Security
Black-box testing
reinforcement learning
transformer
web application firewall

Journal

IEEE Transactions on Dependable and Secure Computing cover
IEEE Transactions on Dependable and Secure Computing
IF:
7.5
Papers:
2.4K
Citations:
9.6K

Organization

B
beijing university of posts & telecommunications
Scholars:
1.4W
Papers: 1.2W
Citations: 9