Metamorphic testing: testing the untestable

Segura, Sergio, Towey, Dave, Zhou, Zhi Quan and Chen, Tsong Yueh (2018) Metamorphic testing: testing the untestable. IEEE Software . p. 1. ISSN 0740-7459

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Available under Licence Creative Commons Attribution.
Download (1MB) | Preview


What if we could know that a program is buggy, even if we could not tell whether or not its observed output is correct? This is one of the key strengths of metamorphic testing, a technique where failures are not revealed by checking an individual concrete output, but by checking the relations among the inputs and outputs of multiple executions of the program under test. Two decades after its introduction, metamorphic testing has become a fully-fledged testing technique with successful applications in multiple domains, including online search engines, autonomous machinery, compilers, Web APIs, and deep learning programs, among others. This article serves as a hands-on entry point for newcomers to metamorphic testing, describing examples, possible applications, and current limitations, providing readers with the basics for the application of the technique in their own projects. IEEE

Item Type: Article
Additional Information: The paper is under GUPL
Keywords: Software testing; metamorphic testing; oracle problem; test case generation
Schools/Departments: University of Nottingham Ningbo China > Faculty of Science and Engineering > School of Computer Science
Identification Number:
Depositing User: QIU, Lulu
Date Deposited: 28 Feb 2020 03:55
Last Modified: 28 Feb 2020 03:55

Actions (Archive Staff Only)

Edit View Edit View