Metamorphic Testing: A Review of Challenges and Opportunities

被引：282
|
作者：
Chen, Tsong Yueh [1 ]
Kuo, Fei-Ching [1 ]
Liu, Huai [2 ]
Poon, Pak-Lok [3 ]
Towey, Dave [4 ]
Tse, T. H. [5 ]
Zhou, Zhi Quan [6 ]
机构：
[1] Swinburne Univ Technol, Dept Comp Sci & Software Engn, John St, Hawthorn, Vic 3122, Australia
[2] Victoria Univ, Coll Engn & Sci, POB 14428, Melbourne, Vic 8001, Australia
[3] RMIT Univ, Sch Business IT & Logist, Melbourne, Vic 3001, Australia
[4] Univ Nottingham Ningbo China, Sch Comp Sci, Ningbo 315100, Zhejiang, Peoples R China
[5] Univ Hong Kong, Dept Comp Sci, Pokfulam, Hong Kong, Peoples R China
[6] Univ Wollongong, Sch Comp & Informat Technol, Wollongong, NSW 2522, Australia
来源：
ACM COMPUTING SURVEYS | 2018年 / 51卷 / 01期
基金：
澳大利亚研究理事会;
关键词：
Metamorphic testing; metamorphic relation; test case generation; oracle problem; SOFTWARE;
D O I：
10.1145/3143561
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
Metamorphic testing is an approach to both test case generation and test result verification. A central element is a set of metamorphic relations, which are necessary properties of the target function or algorithm in relation to multiple inputs and their expected outputs. Since its first publication, we have witnessed a rapidly increasing body of work examining metamorphic testing from various perspectives, including metamorphic relation identification, test case generation, integration with other software engineering techniques, and the validation and evaluation of software systems. In this article, we review the current research of metamorphic testing and discuss the challenges yet to be addressed. We also present visions for further improvement of metamorphic testing and highlight opportunities for new research.
引用
收藏
页数：27
相关论文
共 50 条
  • [1] Metamorphic Testing For Machine Learning: Applicability, Challenges, and Research Opportunities
    Rehman, Faqeer Ur
    Srinivasan, Madhusudan
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE TESTING, AITEST, 2023, : 34 - 39
  • [2] Metamorphic Testing: Challenges Ahead
    Segura, Sergio
    [J]. 2018 IEEE/ACM 3RD INTERNATIONAL WORKSHOP ON METAMORPHIC TESTING (MET 2018), 2018, : 1 - 1
  • [3] Achievements and Challenges of Metamorphic Testing
    Hui, Zhan-wei
    Huang, Song
    [J]. 2013 FOURTH WORLD CONGRESS ON SOFTWARE ENGINEERING (WCSE), 2013, : 73 - 77
  • [4] Performance Metamorphic Testing: Motivation and Challenges
    Segura, Sergio
    Troya, Javier
    Duran, Amador
    Ruiz-Cortes, Antonio
    [J]. 2017 IEEE/ACM 39TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: NEW IDEAS AND EMERGING TECHNOLOGIES RESULTS TRACK (ICSE-NIER), 2017, : 7 - 10
  • [5] Nanomechanical testing: Challenges and opportunities
    Xiaodong Li
    Xinghang Zhang
    [J]. JOM, 2009, 61 : 18 - 18
  • [6] Nanomechanical Testing: Challenges and Opportunities
    Li, Xiaodong
    Zhang, Xinghang
    [J]. JOM, 2009, 61 (12) : 18 - 18
  • [7] Challenges and Opportunities with Concolic Testing
    Kannavara, Raghudeep
    Havlicek, Christopher J.
    Chen, Bo
    Tuttle, Mark R.
    Cong, Kai
    Ray, Sandip
    Xie, Fei
    [J]. PROCEEDINGS OF THE 2015 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2015, : 374 - 378
  • [8] GUI Testing in Production: Challenges and Opportunities
    Denaro, Giovanni
    Guglielmo, Luca
    Mariani, Leonardo
    Riganelli, Oliviero
    [J]. PROGRAMMING 2019: PROCEEDINGS OF THE CONFERENCE COMPANION OF THE 3RD INTERNATIONAL CONFERENCE ON ART, SCIENCE, AND ENGINEERING OF PROGRAMMING, 2019,
  • [9] Critical review of challenges and opportunities for portable nucleic acid testing in water sources
    Ianniello, Crescenzo
    Kasprzyk-Hordern, Barbara
    Reis, Nuno M.
    [J]. CHEMICAL ENGINEERING JOURNAL, 2024, 497
  • [10] Applicability of the DPRA on mixture testing: Challenges and opportunities
    Marcelis, Q.
    Rogiers, V.
    Deconinck, E.
    Desmedt, B.
    Vanhaecke, T.
    [J]. TOXICOLOGY LETTERS, 2023, 384 : S266 - S267
12345