Article detail · 2006
Covering arrays for efficient fault characterization in complex configuration spaces
- Year
- 2006
- Type
- article
Data source split
- YÖKSİS YÖKSİS article record
- YÖKSİS venue IEEE Transactions on Software Engineering
- Catalog match (ISSN) IEEE Transactions on Software Engineering
- OpenAlex OpenAlex enrichment (abstract, citations, topics)
Abstract
OpenAlex · English
Many modern software systems are designed to be highly configurable so they can run on and be optimized for a wide variety of platforms and usage scenarios. Testing such systems is difficult because, in effect, you are testing a multitude of systems, not just one. Moreover, bugs can and do appear in some configurations, but not in others. Our research focuses on a subset of these bugs that are "option-related"-those that manifest with high probability only when specific configuration options take on specific settings. Our goal is not only to detect these bugs, but also to automatically characterize the configuration subspaces (i.e., the options and their settings) in which they manifest. To improve efficiency, our process tests only a sample of the configuration space, which we obtain from mathematical objects called covering arrays. This paper compares two different kinds of covering arrays for this purpose and assesses the effect of sampling strategy on fault characterization accuracy. Our results strongly suggest that sampling via covering arrays allows us to characterize option-related failures nearly as well as if we had tested exhaustively, but at a much lower cost. We also provide guidelines for using our approach in practice.
Topics
Citations
OpenAlex cited_by_count. Not a WoS or Scopus citation count; those sources have no separate column here.
270 citations
OpenAlex cited_by_count (cache / database)
21 publications in the local catalog that cite this work (OpenAlex reference match; not the full global list).
- Reducing Masking Effects in Combinatorial Interaction Testing: A Feedback DrivenAdaptive Approach 2014
- Skoll: A Process and Infrastructure for Distributed Continuous Quality Assurance 2007
- Feedback driven adaptive combinatorial testing 2011
- Main effects screening 2005
- Test Case Aware Combinatorial Interaction Testing 2013
- CHiP: A Configurable Hybrid Parallel Covering Array Constructor 2019
- CHiP: A Configurable Hybrid Parallel Covering Array Constructor 2019
- iGen: dynamic interaction inference for configurable software 2016
- Reliable Effects Screening A Distributed Continuous Quality Assurance Process for Monitoring Performance Degradation in Evolving Software Systems 2007
- Main effects screening: a distributed continuous quality assurance process for monitoring performance degradation in evolving software systems 2005