arrow
Return

Beating Random Test Case Prioritization

delete2021-06-01
delete11
delete
OA
AI
Z
Zhi Quan Zhou *
C
Chen Liu
T
Tsong Yueh Chen
T
T.H. Tse
W
Willy Susilo
DOI:10.1109/TR.2020.2979815delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Existing test case prioritization (TCP) techniques have limitations when applied to real-world projects, because these techniques require certain information to be made available before they can be applied. For example, the family of input-based TCP techniques are based on test case values or test script strings; other techniques use test coverage, test history, program structure, or requirements information. Existing techniques also cannot guarantee to always be more effective than random prioritization (RP) that does not have any precondition. As a result, RP remains the most applicable and most fundamental TCP technique. This article proposes an extremely simple, effective, and efficient way to prioritize test cases through the introduction of a dispersity metric. Our technique is as applicable as RP. We conduct empirical studies using 43 different versions of 15 real-world projects. Empirical results show that our technique is more effective than RP. Our algorithm has a linear computational complexity and, therefore, provides a practical solution to the problem of prioritizing very large test suites (such as those containing hundreds of thousands, or millions, of test cases), where the execution time of conventional nonlinear prioritization algorithms can be prohibitive. Our technique also provides a practical solution to TCP when neither input-based nor execution-based techniques are applicable due to lack of information.
Keywords:
Measurement
Software
History
Benchmark testing
Australia
Complexity theory
Adaptive random sequence
adaptive random testing (ART)
dispersity
dispersity metric
dispersity-based prioritization
dissimilarity
natural distance
random prioritization (RP)
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Reliability cover
IEEE Transactions on Reliability
IF:
5.7
Papers:
2.8K
Citations:
8.5K

Organization

U
University of Hong Kong
Scholars:
4.1W
Papers: 3.9W
Citations: 10.1W
U
University of Wollongong
Scholars:
1.3W
Papers: 1.6W
Citations: 2.8W
S
Swinburne University of Technology
Scholars:
9.3K
Papers: 1.2W
Citations: 2.0W
researcher View more organizations
Cited Papers

Cited Papers

Light confinement by a cylindrical metallic waveguide in a dense buffer-gas environment
err2011-05-04
err0
errOAAI
errUlrich Vogl; Anne Saß; Frank Vewinger; Martin Weitz; Alexander Solovev; Yongfeng Mei; Oliver G. Schmidt
errShare
errSave
Geopolitics and discourse
err1992-03-01
err0
PREAI
errGearóid Ó Tuathail; John Agnew
errShare
errSave
Challenges of Cardiac Transplantation Following the Fontan Procedure
err2017-07-11
err0
PREAI
errJames K. Kirklin; F. Bennett Pearce; Robert J. Dabal; Waldemar F. Carlo; David C. Mauchley
errShare
errSave
Factors Affecting Internal Oxygen and Carbon Dioxide Concentration of Citrus Fruits
err1967-12-01
err0
errOAAI
errPaul L. Davis; William G. Chace; Randall H. Cubbedge
errShare
errSave
Photoluminescence of a quantum-dot molecule
err2015-01-05
err0
errOAAI
errStanislav Yu. Kruchinin; Ivan D. Rukhlenko; Anvar S. Baimuratov; Mikhail Yu. Leonov; Vadim K. Turkov; Yurii K. Gun'ko; Alexander V. Baranov; Anatoly V. Fedorov
errShare
errSave
Automated Behavioral Testing of Refactoring Engines
err2013-02-01
err83
PREAI
errSoares, Gustavo; Gheyi, Rohit; Massoni, Tiago
errShare
errSave
Adaptive Random Testing: The ART of test case diversity
err2010-01-01
err267
errOAAI
errChen, Tsong Yueh; Kuo, Fei-Ching; Merkel, Robert G.; Tse, T. H.
errShare
errSave
Prioritizing test cases for regression testing
err2001-10-01
err828
PREAI
errRothermel, G; Untch, RH; Harrold, MJ
errShare
errSave
researcher View more