arrow
Return

A volumetric framework for quantum computer benchmarks

delete2020-11-15
delete45
delete
OA
AI
R
Robin Blume-Kohout *
K
Kevin Young
DOI:10.22331/q-2020-11-15-362delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
We propose a very large family of benchmarks for probing the performance of quantum computers. We call them volumetric benchmarks (VBs) because they generalize IBM's benchmark for measuring quantum volume [1]. The quantum volume benchmark defines a family of square circuits whose depth d and width w are the same. A volumetric benchmark defines a family of rectangular quantum circuits, for which d and w are uncoupled to allow the study of time/space performance trade-offs. Each VB defines a mapping from circuit shapes - (w, d) pairs - to test suites C(w, d). A test suite is an ensemble of test circuits that share a common structure. The test suite C for a given circuit shape may be a single circuit C, a specific list of circuits {C-1 ... C-N} that must all be run, or a large set of possible circuits equipped with a distribution Pr(C). The circuits in a given VB share a structure, which is limited only by designers' creativity. We list some known benchmarks, and other circuit families, that fit into the V13 framework: several families of random circuits, periodic circuits, and algorithm-inspired circuits. The last ingredient defining a benchmark is a success criterion that defines when a processor is judged to have passed a given test circuit. We discuss several options. Benchmark data can be analyzed in many ways to extract many properties, but we propose a simple, universal graphical summary of results that illustrates the Pareto frontier of the d vs w trade-off for the processor being benchmarked.
Keywords:
SUPREMACY
CIRCUITS

Journal

Quantum cover
Quantum
IF:
5.4
Papers:
974
Citations:
1.0W

Organization

U
united states department of energy (doe)
Scholars:
11.3W
Papers: 9.6W
Citations: 246
Cited Papers

Cited Papers

A variational eigenvalue solver on a photonic quantum processor
err2014-07-23
err2.7K
errOAAI
errPeruzzo, Alberto; McClean, Jarrod; Shadbolt, Peter; Yung, Man-Hong; Zhou, Xiao-Qi; Love, Peter J.; Aspuru-Guzik, Alan; O'Brien, Jeremy L.
errShare
errSave
Characterizing quantum supremacy in near-term devices
err2018-04-23
err762
errOAAI
errBoixo, Sergio; Isakov, Sergei, V; Smelyanskiy, Vadim N.; Babbush, Ryan; Ding, Nan; Jiang, Zhang; Bremner, Michael J.; Martinis, John M.; Neven, Hartmut
errShare
errSave
errShare
errSave
WirePrint
err2014-10-05
err0
PREAI
errStefanie Mueller; Sangha Im; Serafima Gurevich; Alexander Teibrich; Lisa Pfisterer; François Guimbretière; Patrick Baudisch
errShare
errSave
researcher View more