Enhancing Search-based Testing with Testability Transformations for Existing APIs

被引:18
|
作者
Arcuri, Andrea [1 ,2 ]
Galeotti, Juan P. [3 ,4 ,5 ]
机构
[1] Kristiania Univ Coll, Prinsens Gate 7-9, N-0152 Oslo, Norway
[2] Oslo Metropolitan Univ, Prinsens Gate 7-9, N-0152 Oslo, Norway
[3] Univ Buenos Aires, Fac Ciencias Exactas & Nat, Dept Computat, Buenos Aires, DF, Argentina
[4] CONICET UBA, ICC, Buenos Aires, DF, Argentina
[5] Pabellon 1,Ciudad Univ,Intendente Guiraldes 2160, Buenos Aires, DF, Argentina
基金
欧洲研究理事会;
关键词
SBST; test generation; testability transformation; system testing; REST; TEST DATA GENERATION; SYMBOLIC EXECUTION; SOFTWARE; SUITE;
D O I
10.1145/3477271
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Search-based software testing (SBST) has been shown to be an effective technique to generate test cases automatically. Its effectiveness strongly depends on the guidance of the fitness function. Unfortunately, a common issue in SBST is the so-called flag problem, where the fitness landscape presents a plateau that provides no guidance to the search. In this article, we provide a series of novel testability transformations aimed at providing guidance in the context of commonly used API calls (e.g., strings that need to be converted into valid date/time objects). We also provide specific transformations aimed at helping the testing of REST Web Services. We implemented our novel techniques as an extension to EvoMaster, an SBST tool that generates system-level test cases. Experiments on nine open-source REST web services, as well as an industrial web service, show that our novel techniques improve performance significantly.
引用
收藏
页数:34
相关论文
共 50 条
  • [1] Testability Transformations For Existing APIs
    Arcuri, Andrea
    Galeotti, Juan P.
    2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VALIDATION AND VERIFICATION (ICST 2020), 2020, : 153 - 163
  • [2] Enhancing White-Box Search-Based Testing of RESTful APIs
    Golmohammadi, Amid
    2023 IEEE 34TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS, ISSREW, 2023, : 9 - 12
  • [3] JavaScript Instrumentation for Search-Based Software Testing: A Study with RESTful APIs
    Zhang, Man
    Belhadi, Asma
    Arcuri, Andrea
    Proceedings - 2022 IEEE 15th International Conference on Software Testing, Verification and Validation, ICST 2022, 2022, : 105 - 115
  • [4] Search-based model transformations
    Fleck, Martin
    Troya, Javier
    Wimmer, Manuel
    JOURNAL OF SOFTWARE-EVOLUTION AND PROCESS, 2016, 28 (12) : 1081 - 1117
  • [5] Java']JavaScript Instrumentation for Search-Based Software Testing: A Study with RESTful APIs
    Zhang, Man
    Belhadi, Asma
    Arcuri, Andrea
    2022 IEEE 15TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2022), 2022, : 105 - 115
  • [6] Search-Based Model Transformations with MOMoT
    Fleck, Martin
    Troya, Javier
    Wimmer, Manuel
    THEORY AND PRACTICE OF MODEL TRANSFORMATIONS, ICMT 2016, 2016, 9765 : 79 - 87
  • [7] EXSYST: Search-Based GUI Testing
    Gross, Florian
    Fraser, Gordon
    Zeller, Andreas
    2012 34TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE), 2012, : 1423 - 1426
  • [8] An automated search-based test model generation approach for structural testing of model transformations
    Jilani, Atif Aftab
    Khan, Muhammad Uzair
    Iqbal, Muhammad Zohaib
    Usman, Muhammad
    JOURNAL OF SOFTWARE-EVOLUTION AND PROCESS, 2022, 34 (11)
  • [9] Search-based testing in membrane computing
    Turlea, Ana
    Gheorghe, Marian
    Ipate, Florentin
    Konur, Savas
    JOURNAL OF MEMBRANE COMPUTING, 2019, 1 (04) : 241 - 250
  • [10] Search-based Testing using EFSMs
    Turlea, Ana
    2019 IEEE 30TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING WORKSHOPS (ISSREW 2019), 2019, : 100 - 103