Journal Home Online First Current Issue Archive For Authors Journal Information 中文版

Frontiers of Information Technology & Electronic Engineering >> 2022, Volume 23, Issue 5 doi: 10.1631/FITEE.2100466

Devising optimal integration test orders using cost–benefit analysis

Affiliation(s): Software College, Northeastern University, Shenyang 110169, China; State Key Lab for Novel Software Technology, Nanjing University, Nanjing 210023, China; less

Received: 2021-09-30 Accepted: 2022-05-19 Available online: 2022-05-19

Next Previous

Abstract

Integration testing is an integral part of software testing. Prior studies have focused on reducing test cost in generation. However, there are no studies concerning the testing priorities of critical classes when generating s. Such priorities greatly affect testing efficiency. In this study, we propose an effective strategy that considers both test cost and efficiency when generating test orders. According to a series of dynamic execution scenarios, the software is mapped into a multi-layer dynamic execution network (MDEN) model. By analyzing the dynamic structural complexity, an evaluation scheme is proposed to quantify the class testing priority with the defined class risk index. ; is used to perform cycle-breaking operations, satisfying two principles: assigning higher priorities to higher-risk classes and minimizing the total complexity of test stubs. We also present a strategy to evaluate the effectiveness of algorithms by calculating the reduction of software risk during their testing process. Experiment results show that our approach performs better across software of different scales, in comparison with the existing algorithms that aim only to minimize test cost. Finally, we implement a tool, ITOsolution, to help practitioners automatically generate test orders.

Related Research