arrow
Return

On Hardware Security Bug Code Fixes by Prompting Large Language Models

delete2024-01-01
delete17
delete
OA
AI
B
Baleegh Ahmad *
S
Shailja Thakur
B
Benjamin Tan
R
Ramesh Karri
H
Hammond Pearce
DOI:10.1109/TIFS.2024.3374558delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Novel AI-based code-writing Large Language Models (LLMs) such as OpenAI's Codex have demonstrated capabilities in many coding-adjacent domains. In this work, we consider how LLMs may be leveraged to automatically repair identified security-relevant bugs present in hardware designs by generating replacement code. We focus on bug repair in code written in Verilog. For this study, we curate a corpus of domain-representative hardware security bugs. We then design and implement a framework to quantitatively evaluate the performance of any LLM tasked with fixing the specified bugs. The framework supports design space exploration of prompts (i.e., prompt engineering) and identifying the best parameters for the LLM. We show that an ensemble of LLMs can repair all fifteen of our benchmarks. This ensemble outperforms a state-of-the-art automated hardware bug repair tool on its own suite of bugs. These results show that LLMs have the ability to repair hardware security bugs and the framework is an important step towards the ultimate goal of an automated end-to-end bug repair tool.
Keywords:
Maintenance engineering
Computer bugs
Codes
Hardware
Security
Software
Registers
Hardware security
large language models
bug repair

Journal

IEEE Transactions on Information Forensics and Security cover
IEEE Transactions on Information Forensics and Security
IF:
8
Papers:
5.3K
Citations:
2.3W

Organization

U
University of Calgary
Scholars:
3.8W
Papers: 3.3W
Citations: 52
N
New York University
Scholars:
4.4W
Papers: 3.9W
Citations: 5.8W
N
New York University Tandon School of Engineering
Scholars:
1.1K
Papers: 854
Citations: 0
researcher View more organizations
Cited Papers

Cited Papers

Genomic Diversity amongStreptococcus agalactiaeIsolates Detected by a Degenerate Oligonucleotide‐Primed Amplification Assay
err1998-05-01
err0
errOAAI
errAdriana S. Limansky; Emma G. Sutich; María C. Guardati; Inés E. Toresani; Alejandro M. Viale
errShare
errSave
Automated Program Repair
err2019-11-21
err231
PREAI
errLe Goues, Claire; Pradel, Michael; Roychoudhury, Abhik
errShare
errSave
An Empirical Study on Learning Bug-Fixing Patches in the Wild via Neural Machine Translation
err2019-09-02
err204
errOAAI
errTufano, Michele; Watson, Cody; Bavota, Gabriele; Di Penta, Massimiliano; White, Martin; Poshyvanyk, Denys
errShare
errSave
A novel method to quantify exchangeable hydrogen fraction in organic matter
err
IF0
err2020-03-23
err0
PREAI
errCristian Gudasz; David X. Soto; Tobias Sparrman; Jan Karlsson
errShare
errSave
errShare
errSave
Deviant Peers and Adolescent Risky Behaviors: The Protective Effect of Nonverbal Display of Parental Warmth
err2018-06-22
err0
errOAAI
errMarie‐Ève Daspe; Reout Arbel; Michelle C. Ramos; Lauren A. S. Shapiro; Gayla Margolin
errShare
errSave
LoopFix: an approach to automatic repair of buggy loops
err2019-10-01
err4
PREAI
errWang, Weichao; Meng, Zhaopeng; Wang, Zan; Liu, Shuang; Hao, Jianye
errShare
errSave
researcher View more