Enhancing Search-based Testing with Testability Transformations for Existing APIs

被引:18
|
作者
Arcuri, Andrea [1 ,2 ]
Galeotti, Juan P. [3 ,4 ,5 ]
机构
[1] Kristiania Univ Coll, Prinsens Gate 7-9, N-0152 Oslo, Norway
[2] Oslo Metropolitan Univ, Prinsens Gate 7-9, N-0152 Oslo, Norway
[3] Univ Buenos Aires, Fac Ciencias Exactas & Nat, Dept Computat, Buenos Aires, DF, Argentina
[4] CONICET UBA, ICC, Buenos Aires, DF, Argentina
[5] Pabellon 1,Ciudad Univ,Intendente Guiraldes 2160, Buenos Aires, DF, Argentina
基金
欧洲研究理事会;
关键词
SBST; test generation; testability transformation; system testing; REST; TEST DATA GENERATION; SYMBOLIC EXECUTION; SOFTWARE; SUITE;
D O I
10.1145/3477271
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Search-based software testing (SBST) has been shown to be an effective technique to generate test cases automatically. Its effectiveness strongly depends on the guidance of the fitness function. Unfortunately, a common issue in SBST is the so-called flag problem, where the fitness landscape presents a plateau that provides no guidance to the search. In this article, we provide a series of novel testability transformations aimed at providing guidance in the context of commonly used API calls (e.g., strings that need to be converted into valid date/time objects). We also provide specific transformations aimed at helping the testing of REST Web Services. We implemented our novel techniques as an extension to EvoMaster, an SBST tool that generates system-level test cases. Experiments on nine open-source REST web services, as well as an industrial web service, show that our novel techniques improve performance significantly.
引用
收藏
页数:34
相关论文
共 50 条
  • [41] Instance Space Analysis of Search-Based Software Testing
    Neelofar, Neelofar
    Smith-Miles, Kate
    Munoz, Mario Andres
    Aleti, Aldeida
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2023, 49 (04) : 2642 - 2660
  • [42] An extensive evaluation of search-based software testing: a review
    Manju Khari
    Prabhat Kumar
    Soft Computing, 2019, 23 : 1933 - 1946
  • [43] Signal Generation for Search-Based Testing of Continuous Systems
    Windisch, Andreas
    Al Moubayed, Noura
    ICSTW 2009: IEEE INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION, AND VALIDATION WORKSHOPS, 2009, : 121 - +
  • [44] AmbieGen: A search-based framework for autonomous systems testing
    Humeniuk, Dmytro
    Khomh, Foutse
    Antoniol, Giuliano
    SCIENCE OF COMPUTER PROGRAMMING, 2023, 230
  • [45] Footprints of Fitness Functions in Search-Based Software Testing
    Oliveira, Carlos
    Aleti, Aldeida
    Li, Yuan-Fang
    Abdelrazek, Mohamed
    PROCEEDINGS OF THE 2019 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'19), 2019, : 1399 - 1407
  • [46] Transferring interactive search-based software testing to industry
    Marculescu, Bogdan
    Feldt, Robert
    Torkar, Richard
    Poulding, Simon
    JOURNAL OF SYSTEMS AND SOFTWARE, 2018, 142 : 156 - 170
  • [47] Enhancing Search-Based Product Line Design with Crossover Operators
    da Silva, Diego Fernandes
    Okada, Luiz Fernando
    Colanzi, Thelma Elita
    Assuncao, Wesley K. G.
    GECCO'20: PROCEEDINGS OF THE 2020 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2020, : 1250 - 1258
  • [48] Advanced White-Box Heuristics for Search-Based Fuzzing of REST APIs
    Arcuri, Andrea
    Zhang, Man
    Pablo Galeotti, Juan
    ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2024, 33 (06)
  • [49] Enhancing logic-based testing with EvoDomain: A search-based domain-oriented test suite generation approach
    Kalaee, Akram
    Parsa, Saeed
    Mansouri, Zahra
    Information and Software Technology, 2025, 177
  • [50] A Theoretical and Empirical Study of Search-Based Testing: Local, Global, and Hybrid Search
    Harman, Mark
    McMinn, Phil
    IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 2010, 36 (02) : 226 - 247