arrow
Return

An upper bound on software testing effectiveness

delete2008-06-27
delete76
PRE
AI
T
Tsong Yueh Chen *
R
Robert Merkel
DOI:10.1145/1363102.1363107delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
Failure patterns describe typical ways in which inputs revealing program failure are distributed across the input domain-in many cases, clustered together in contiguous regions. Based on these observations several debug testing methods have been developed. We examine the upper bound of debug testing effectiveness improvements possible through making assumptions about the shape, size and orientation of failure patterns. We consider the bounds for testing strategies with respect to minimizing the F-measure, maximizing the P-measure, and maximizing the E-measure. Surprisingly, we find that the empirically measured effectiveness of some existing methods that are not based on these assumptions is close to the theoretical upper bound of these strategies. The assumptions made to obtain the upper bound, and its further implications, are also examined.
Keywords:
verification
reliability
theory
measurement
software testing
failure-causing inputs
failure patterns
testing effectiveness metrics
random testing
adaptive random testing
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

S
Swinburne University of Technology
Scholars:
9.3K
Papers: 1.2W
Citations: 2.0W
Cited Papers

Cited Papers

Living-Donor Lobar Lung Transplantation for Pulmonary and Abdominopelvic Lymphangioleiomyomatosis
err2005-04-01
err0
PREAI
errF. Chen; T. Fukuse; S. Hasegawa; T. Bando; N. Hanaoka; M. Kawashima; H. Sakai; M. Komeda; H. Wada
errShare
errSave
High temperature phase transitions and critical exponents of Samarium orthoferrite determined by in situ optical ellipsometry
err2012-03-08
err0
PREAI
errB. Berini; A. Fouchet; E. Popova; J. Scola; Y. Dumont; N. Franco; R. M. C. da Silva; N. Keller
errShare
errSave
Microbial Contamination of Glaucoma Eyedrops Used by Patients Compared With Ocular Medications Used in the Hospital
err2015-02-01
err0
errOAAI
errBarbara Teuchner; Julia Wagner; Nikolaos E. Bechrakis; Dorothea Orth-Höller; Markus Nagl
errShare
errSave
The Zebrafish as a Model Host for Invasive Fungal Infections
err2018-12-13
err0
errOAAI
errEmily E. Rosowski; Benjamin P. Knox; Linda S. Archambault; Anna Huttenlocher; Nancy P. Keller; Robert T. Wheeler; J. Muse Davis
errShare
errSave
Mirror adaptive random testing
err2004-12-01
err62
errOAAI
errChen, TY; Kuo, FC; Merkel, RG; Ng, SP
errShare
errSave
The ARF Tumor Suppressor Regulates Bone Remodeling and Osteosarcoma Development in Mice
err2010-12-30
err0
errOAAI
errDaniel A. Rauch; Michelle A. Hurchla; John C. Harding; Hongju Deng; Lauren K. Shea; Mark C. Eagleton; Stefan Niewiesk; Michael D. Lairmore; David Piwnica-Worms; Thomas J. Rosol; Jason D. Weber; Lee Ratner; Katherine N. Weilbaecher
errShare
errSave
researcher View more