The Category Partition (CP) black-box testing method has shown to be effective in a number of situations. There is however little support for automating its use and little is known about the cost effectiveness of its associated selection criteria. In this paper, we report on a tool to automatically create test frames, i.e., test case specifications, for three well-known criteria associated with the CP method, including the application of 1-way and 2-way interactions. We then report on the cost, in terms of number of test cases, and the effectiveness, in terms of mutation score, of adequate test suites for these criteria. The main lesson learnt is that, in addition to the intuition that the CP specification does impact effectiveness, a significant part of the effectiveness is also due to the test input selection procedure for test frames.

Additional Metadata
Keywords 1-way, 2-way, category partition, cost, effectiveness, experimentation, mutation, selection criteria, tool
Persistent URL dx.doi.org/10.1109/ICSTW.2013.41
Conference IEEE 6th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2013
Citation
Labiche, Y, & Sadeghi, F.R. (Faezeh Rafsanjani). (2013). Experimenting with Category Partition's 1-way and 2-way test selection criteria. Presented at the IEEE 6th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2013. doi:10.1109/ICSTW.2013.41