On Hardware Security Bug Code Fixes by Prompting Large Language Models

doi:10.1109/TIFS.2024.3374558

On Hardware Security Bug Code Fixes by Prompting Large Language Models

2024-01-01

17

OA

AI

DOI：10.1109/TIFS.2024.3374558

Original

Original request for help

Save

Abstract

En 中文

Novel AI-based code-writing Large Language Models (LLMs) such as OpenAI's Codex have demonstrated capabilities in many coding-adjacent domains. In this work, we consider how LLMs may be leveraged to automatically repair identified security-relevant bugs present in hardware designs by generating replacement code. We focus on bug repair in code written in Verilog. For this study, we curate a corpus of domain-representative hardware security bugs. We then design and implement a framework to quantitatively evaluate the performance of any LLM tasked with fixing the specified bugs. The framework supports design space exploration of prompts (i.e., prompt engineering) and identifying the best parameters for the LLM. We show that an ensemble of LLMs can repair all fifteen of our benchmarks. This ensemble outperforms a state-of-the-art automated hardware bug repair tool on its own suite of bugs. These results show that LLMs have the ability to repair hardware security bugs and the framework is an important step towards the ultimate goal of an automated end-to-end bug repair tool.

Keywords:

Maintenance engineering

Computer bugs

Codes

Hardware

Security

Software

Registers

Hardware security

large language models

bug repair

On Hardware Security Bug Code Fixes by Prompting Large Language Models

Abstract

Journal

Organization