arrow
Return

Build It, Break It, Fix It: Contesting Secure Development

delete2020-04-17
delete10
delete
OA
AI
J
James Parker *
M
Michael Hicks
A
Andrew Ruef
M
Michelle L. Mazurek
D
Dave Levin
V
Votipka, Daniel
P
Piotr Mardziel
K
Kelsey R. Fulton
DOI:10.1145/3383773delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Typical security contests focus on breaking or mitigating the impact of buggy systems. We present the Build-it, Break-it, Fix-it (BIBIFI) contest, which aims to assess the ability to securely build software, not just break it. In BIBIFI, teams build specified software with the goal of maximizing correctness, performance, and security. The latter is tested when teams attempt to break other teams' submissions. Winners are chosen from among the best builders and the best breakers. BIBIFI was designed to be open-ended-teams can use any language, tool, process, and so on, that they like. As such, contest outcomes shed light on factors that correlate with successfully building secure software and breaking insecure software. We ran three contests involving a total of 156 teams and three different programming problems. Quantitative analysis from these contests found that the most efficient build-it submissions used C/C++, but submissions coded in a statically type safe language were 11x less likely to have a security flaw than C/C++ submissions. Break-it teams that were also successful build-it teams were significantly better at finding security bugs.
Keywords:
Contest
security
education
software
engineering
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

A
ACM Transactions on Privacy and Security
IF:
2.8
Papers:
291
Citations:
770

Organization

University System of Maryland cover
University System of Maryland
Scholars:
6.4W
Papers: 5.6W
Citations: 113