arrow
Return

Inputs From Hell: Learning Input Distributions for Grammar-Based Test Generation

delete2022-04-01
delete15
delete
OA
AI
E
Ezekiel Soremekun *
E
Esteban Pavese
N
Nikolas Havrikov
L
Lars Grunske
A
Andreas Zeller
DOI:10.1109/TSE.2020.3013716delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Grammars can serve as producers for structured test inputs that are syntactically correct by construction. A probabilistic grammar assigns probabilities to individual productions, thus controlling the distribution of input elements. Using the grammars as input parsers, we show how to leant input distributions from input samples, allowing to create inputs that are similar to the sample; by inverting the probabilities, we can create inputs that are dissimilar to the sample. This allows for three test generation strategies: 1) Common inputs-by learning from common inputs, we can create inputs that are similar to the sample; this is useful for regression testing. 2) Uncommon inputs-learning from common inputs and inverting probabilities yields inputs that are strongly dissimilar to the sample; this is useful for completing a test suite with inputs from hell that test uncommon features, yet are syntactically valid. 3) Failure-inducing inputs-learning from inputs that caused failures in the past gives us inputs that share similar features and thus also have a high chance of triggering bugs; this is useful for testing the completeness of fixes. Our evaluation on three common input formats (JSON, JavaScript, CSS) shows the effectiveness of these approaches. Results show that common inputs reproduced 96 percent of the methods induced by the samples. In contrast, for almost all subjects (95 percent), the uncommon inputs covered significantly different methods from the samples. Learning from failure-inducing samples reproduced all exceptions (100 percent) triggered by the failure-inducing samples and discovered new exceptions not found in any of the samples learned from.
Keywords:
Test case generation
probabilistic grammars
input samples
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Transactions on Software Engineering cover
IEEE Transactions on Software Engineering
IF:
5.6
Papers:
2.9K
Citations:
1.1W

Organization

H
Humboldt University of Berlin
Scholars:
3.2W
Papers: 2.7W
Citations: 47
U
university of luxembourg
Scholars:
5.2K
Papers: 4.8K
Citations: 4
Cited Papers

Cited Papers

Cysteine Dioxygenase 1 Is a Tumor Suppressor Gene Silenced by Promoter Methylation in Multiple Human Cancers
err2012-09-27
err0
errOAAI
errMariana Brait; Shizhang Ling; Jatin K. Nagpal; Xiaofei Chang; Hannah Lui Park; Juna Lee; Jun Okamura; Keishi Yamashita; David Sidransky; Myoung Sook Kim
errShare
errSave
Crystallographic structure and magnetic properties of polycrystalline FePd thin films on glass substrate
err2015-01-22
err0
PREAI
errS. H. Liu; C. C. Chen; S. N. Hsiao; S. K. Chen; Y. C. Chang; S. H. Su; K. F. Chiu
errShare
errSave
Efficient Bone Conduction Hearing Device With a Novel Piezoelectric Transducer Using Skin as an Electrode
err2022-11-01
err0
errOAAI
errIchiro Furuta; Hideaki Ogita; Fukuichiro Iguchi; Takayuki Okano; Kohei Yamahara; Tatsuya Namatsu; Shuichi Kawata; Koichi Omori; Norio Yamamoto
errShare
errSave
Exploring Perceptual Intensity Properties Using Electrotactile Stimulation on Fingertips
err2023-10-01
err0
PREAI
errZiliang Zhou; Xiaoxin Wang; Yicheng Yang; Jia Zeng; Honghai Liu
errShare
errSave
A Survey on Software Fault Localization
err2016-08-01
err741
errOAAI
errWong, W. Eric; Gao, Ruizhi; Li, Yihao; Abreu, Rui; Wotawa, Franz
errShare
errSave
Kimberlite Terminology and Classification
err2013-07-12
err0
PREAI
errB. H. Scott Smith; T. E. Nowicki; J. K. Russell; K. J. Webb; R. H. Mitchell; C. M. Hetman; M. Harder; E. M. W. Skinner; Jv. A. Robey
errShare
errSave
Infrared Study of Comparative Adsorption of Some Alcohols and Thiols on γ- Alumina
err1982-01-01
err0
PREAI
errJ. Travert; O. Saur; M. Benaissa; J. Lamotte; J. C. Lavalley
errShare
errSave
AN EMPIRICAL-STUDY OF THE RELIABILITY OF UNIX UTILITIES
err1990-12-01
err718
errOAAI
errMILLER, BP; FREDRIKSEN, L; SO, B
errShare
errSave
researcher View more