arrow
Return

Generating Effective Software Obfuscation Sequences With Reinforcement Learning

delete2022-05-01
delete3
PRE
AI
H
Huaijin Wang
S
Shuai Wang *
D
Dongpeng Xu
X
Xiangyu Zhang
刘笑 cover
刘笑 (Xiao Liu)
DOI:10.1109/TDSC.2020.3041655delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Obfuscation is a prevalent security technique which transforms syntactic representation of a program to a complicated form, but still keeps program semantics unchanged. So far, developers heavily rely on obfuscation to harden their products and reduce the risk of adversarial reverse engineering. However, despite its spectacular progress, one crucial hurdle is that each of existing obfuscation method is designed specifically for obfuscating one program feature (e.g., identifier name, control flow), so an effective obfuscation scheme usually composes a considerable amount of different obfuscation methods. Therefore, one primary challenge lies in identifying effective combinations of obfuscation methods. In this research, we propose a principled technique for generating an optimal program obfuscation scheme by adopting a reinforcement learning approach. Given a program and a set of obfuscation transformations, a reinforcement learning model is progressively trained to select a sequence of obfuscation transformations, such that applying each transformation in order toward the program yields the optimal obfuscation result, making programs dissimilar while retaining reasonable instrumentation overhead. Our implementation can directly work on raw binary executables without source code, and our evaluation demonstrates that the trained models can effectively obfuscate executable files with low cost.
Keywords:
Software
Transforms
Reinforcement learning
Reverse engineering
Control systems
Tools
Switches
Software obfuscation
reinforcement learning
reverse engineering
software similarity
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Dependable and Secure Computing cover
IEEE Transactions on Dependable and Secure Computing
IF:
7.5
Papers:
2.4K
Citations:
9.6K

Organization

University System of New Hampshire cover
University System of New Hampshire
Scholars:
5.3K
Papers: 4.9K
Citations: 13
U
university of new hampshire
Scholars:
4.2K
Papers: 3.4K
Citations: 8