arrow
Return

New Reliability-Driven Bounds for Architecture-Based Multi-Objective Testing Resource Allocation

delete2023-04-01
delete1
PRE
AI
G
Guofu Zhang
L
Lei Li
Z
Zhaopin Su *
Z
Zhisheng Shao
M
Miqing Li
李
李斌 (Bin Li)
X
Xin Yao
DOI:10.1109/TSE.2022.3223875delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The multi-objective testing resource allocation problem (MOTRAP) aims at seeking a good trade-off between system reliability, testing cost, and testing time, which is of significant importance to facilitate the testing planning. Yet most studies focus on the time constraint but rarely consider the practical reliability requirement. In this work, we address MOTRAP on an architecture-based model (ABM) with the personalized preference over reliability. More specifically, we first present a reliability-constrained MOTRAP model on the basis of ABM and illustrate how to use this model for real-world systems. Then, to leverage the problem's knowledge, we develop new lower and upper bounds on testing time invested in different components from both theoretical and algorithmic perspectives on the basis of the Lagrange multiplier and half-interval search. Importantly, these new derived bounds have strong implications due to the fact that they can be easily employed by optimizers as the limits of variables to prune the search space to the region of interests of the decision maker and locate feasible solutions with the expected reliability. Finally, we evaluate the proposed bounds in popular multi-objective optimizers for MOTRAP on application and empirical cases. Experimental results demonstrate that our new bounds practically improve the search performance of optimizers, and decision makers can easily combine these new bounds with off-the-shelf optimizers to find higher-quality solutions that they are interested in, which greatly soothes away stress on optimizer and solution selections of decision makers.
Keywords:
Reliability
Testing
Software reliability
Costs
Reliability theory
Search problems
Software systems
Multi-objective testing resource allocation
architecture-based model
preference over reliability
region of interest
lower and upper bounds

Journal

IEEE Transactions on Software Engineering cover
IEEE Transactions on Software Engineering
IF:
5.6
Papers:
2.8K
Citations:
1.1W

Organization

H
hefei university of technology
Scholars:
2.5W
Papers: 1.7W
Citations: 35
U
University of Birmingham
Scholars:
4.1W
Papers: 3.8W
Citations: 5.0W
C
chinese academy of sciences
Scholars:
56.7W
Papers: 45.0W
Citations: 704
researcher View more organizations
Cited Papers

Cited Papers

Constraint Handling in NSGA-II for Solving Optimal Testing Resource Allocation Problems
err2017-12-01
err33
errOAAI
errZhang, Guofu; Su, Zhaopin; Li, Miqing; Yue, Feng; Jiang, Jianguo; Yao, Xin
errShare
errSave
Twenty-eight years of component-based software engineering
err2016-01-01
err100
PREAI
errVale, Tassio; Crnkovic, Ivica; de Almeida, Eduardo Santana; da Mota Silveira Netocd, Paulo Anselmo; Cavalcanti, Yguarata Cerqueira; de Lemos Meira, Silvio Romero
errShare
errSave
errShare
errSave
Transferring interactive search-based software testing to industry
err2018-08-01
err14
errOAAI
errMarculescu, Bogdan; Feldt, Robert; Torkar, Richard; Poulding, Simon
errShare
errSave
researcher View more