arrow
Return

Oracles for Testing Software Timeliness with Uncertainty

delete2018-11-16
delete11
delete
OA
AI
C
Chunhui Wang *
F
Fabrizio Pastore
L
Lionel Briand
DOI:10.1145/3280987delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
Uncertainty in timing properties (e.g., detection time of external events) is a common occurrence in embedded software systems, since these systems interact with complex physical environments. Such time uncertainty leads to non-determinism. For example, time-triggered operations may either generate different valid outputs across different executions or experience failures (e.g., results not being generated in the expected time window) that occur only occasionally over many executions. For these reasons, time uncertainty makes the generation of effective test oracles for timing requirements a challenging task. To address the above challenge, we propose Stochastic Testing with Unique Input Output Sequences, an approach for the automated generation of stochastic oracles that verify the capability of a software system to fulfill timing constraints in the presence of time uncertainty. Such stochastic oracles entail the statistical analysis of repeated test case executions based on test output probabilities predicted by means of statistical model checking. Results from two industrial case studies in the automotive domain demonstrate that this approach improves the fault detection effectiveness of tests suites derived from timed automata compared to traditional approaches.
Keywords:
Time uncertainty
probabilistic unique input output sequences
timing specifications
test oracles generation
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

A
ACM Transactions on Software Engineering and Methodology
IF:
6.2
Papers:
1.2K
Citations:
3.4K

Organization

U
university of luxembourg
Scholars:
5.2K
Papers: 4.8K
Citations: 4