© 1999 by British Computer Society
| ||||||||||||||||||||||||||||||||||||||||||||||||||||
A New Perspective of the Proportional Sampling Strategy
1 Department of Computer Science, New Mexico State University, Las Cruces, NM 88003, USA Email: tychen@csis.hku.hk 2 Department of Computer Science and Software Engineering, The University of Melbourne, Parkville 3052, Australia and Vocational Training Council, Hong Kong
To compare the performance of different testing strategies, P-measure and E-measure are two effectiveness measures used in previous analytical studies. P-measure, which is defined as the probability of detecting at least one failure, is a measure of how likely it is that failure-causing inputs are selected at least once as test cases. E-measure, which is defined as the expected number of failures detected, is a measure of how frequently failure-causing inputs are selected as test cases. However, we have no a priori knowledge of how many failure-causing inputs there are, or where they may lie. In this paper, we study P-measure and E-measure in terms of how much attention an arbitrary input receives. In the context of P-measure, the attention received by an arbitrary input is the probability that the input is selected at least once as a test case, while in the context of E-measure, the attention is the expected number of times that an input is selected as a test case. The attentions received by an input using the proportional sampling strategy and random testing are then compared. The attention received by an input is found to be the same under the two testing strategies for E-measure, whereas for P-measure the attention is always higher for the proportional sampling strategy than for random testing. This new perspective allows us to provide simpler proofs of some known results. Furthermore, we are able to show that the difference in the expected number of distinct test cases considered by the proportional sampling strategy is larger than that of random testing by at most 2k, where k is the number of partitions and is independent of the number of test cases selected.
Received 4 August, 1997. Revised 12 October, 1999.