Measuring software dependability by robustness benchmarking

A. Mukherjee

doi:10.1109/32.601075

Measuring software dependability by robustness benchmarking

1997-06-01

44

PRE

AI

DOI：10.1109/32.601075

Original

Original request for help

Save

Abstract

En 中文

Inability to identify weaknesses or to quantify advancements in software system robustness frequently hinders the development of robust software systems. Efforts have been made to develop benchmarks of software robustness to address this problem, but they all suffer from significant shortcomings. This paper presents the various features that are desirable in a benchmark of system robustness, and evaluates some existing benchmarks according to these features. A new hierarchically structured approach to building robustness benchmarks, which overcomes many deficiencies of past efforts, is also presented. This approach has been applied to building a hierarchically structured benchmark that tests part of the Unix file and virtual memory systems. The resultant benchmark has successfully been used to identify new response class structures that were not detected in a similar situation by other less organized techniques.

Keywords:

system reliability

software dependability

robustness benchmarking

test suite organization

object-oriented benchmarks

software validation

extensible benchmarks

Measuring software dependability by robustness benchmarking

Abstract

Journal

Organization