Accounting for Defect Characteristics in Evaluations of Testing Techniques
As new software-testing techniques are developed, and before they can achieve widespread acceptance, their effectiveness at detecting defects must be evaluated. The most common way to evaluate testing techniques is with empirical studies, in which one or more techniques are tried out on software with known defects. However, the defects used can affect the performance of the techniques. To complicate matters, it is not even clear how to effectively describe or characterize defects. To address these problems, this work describes an experiment architecture for empirically evaluating testing techniques, which takes both defect and test-suite characteristics into account.