Home // VALID 2012, The Fourth International Conference on Advances in System Testing and Validation Lifecycle // View article

Cost-Aware Combinatorial Interaction Testing

Authors:
Gulsen Demiroz
Cemal Yilmaz

Keywords: Software quality assurance, combinatorial interaction testing, covering arrays

Abstract:
The configuration spaces of modern software systems are often too large to test exhaustively. Combinatorial interaction testing approaches, such as covering arrays, systematically sample the configuration space and test only the selected configurations. Traditional t-way covering arrays aim to cover all t-way combinations of option settings in a minimum number of configurations. By doing so, they assume that the testing cost of a configuration is the same for all configurations. In this work, we however argue that, in practice, the actual testing cost may differ from one configuration to another and that accounting for these differences can improve the cost-effectiveness of covering arrays. We first introduce a novel combinatorial object, called a {it cost-aware covering array}. A t-way cost-aware covering array is a t-way covering array that minimizes a given cost function. We then provide a framework for defining the cost function. Finally, we present an algorithm to compute cost-aware covering arrays for a simple, yet important scenario, and empirically evaluate the cost-effectiveness of the proposed approach. The results of our empirical studies suggest that cost-aware covering arrays, depending on the configuration space model used, can greatly reduce the actual cost of testing compared to traditional covering arrays.

Pages: 9 to 16

Copyright: Copyright (c) IARIA, 2012

Publication date: November 18, 2012

Published in: conference

ISSN: 2308-4316

ISBN: 978-1-61208-233-2

Location: Lisbon, Portugal

Dates: from November 18, 2012 to November 23, 2012