Regression test case prioritization by code combinations coverage

Huang, Rubing and Zhang, Quanjun and Towey, Dave and Sun, Weifeng and Chen, Jinfu (2020) Regression test case prioritization by code combinations coverage. Journal of Systems and Software, 169 . p. 110712. ISSN 01641212

[img]
Preview
PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Available under Licence Creative Commons Attribution.
Download (3MB) | Preview

Abstract

Regression test case prioritization (RTCP) aims to improve the rate of fault detection by executing more important test cases as early as possible. Various RTCP techniques have been proposed based on different coverage criteria. Among them, a majority of techniques leverage code coverage information to guide the prioritization process, with code units being considered individually, and in isolation. In this paper, we propose a new coverage criterion, code combinations coverage, that combines the concepts of code coverage and combination coverage. We apply this coverage criterion to RTCP, as a new prioritization technique, code combinations coverage based prioritization (CCCP). We report on empirical studies conducted to compare the testing effectiveness and efficiency of CCCP with four popular RTCP techniques: total, additional, adaptive random, and search-based test prioritization. The experimental results show that even when the lowest combination strength is assigned, overall, the CCCP fault detection rates are greater than those of the other four prioritization techniques. The CCCP prioritization costs are also found to be comparable to the additional test prioritization technique. Moreover, our results also show that when the combination strength is increased, CCCP provides higher fault detection rates than the state-of-the-art, regardless of the levels of code coverage.

Item Type: Article
Keywords: Software testing;Regression testing;Test case prioritization Code combinations coverage
Schools/Departments: University of Nottingham Ningbo China > Faculty of Science and Engineering > School of Computer Science
Identification Number: https://doi.org/10.1016/j.jss.2020.110712
Depositing User: Zhou, Elsie
Date Deposited: 30 Jul 2020 06:11
Last Modified: 30 Jul 2020 06:11
URI: http://eprints.nottingham.ac.uk/id/eprint/61146

Actions (Archive Staff Only)

Edit View Edit View