Enhancing Search-based Testing with Testability Transformations for Existing APIs

被引:18
|
作者
Arcuri, Andrea [1 ,2 ]
Galeotti, Juan P. [3 ,4 ,5 ]
机构
[1] Kristiania Univ Coll, Prinsens Gate 7-9, N-0152 Oslo, Norway
[2] Oslo Metropolitan Univ, Prinsens Gate 7-9, N-0152 Oslo, Norway
[3] Univ Buenos Aires, Fac Ciencias Exactas & Nat, Dept Computat, Buenos Aires, DF, Argentina
[4] CONICET UBA, ICC, Buenos Aires, DF, Argentina
[5] Pabellon 1,Ciudad Univ,Intendente Guiraldes 2160, Buenos Aires, DF, Argentina
基金
欧洲研究理事会;
关键词
SBST; test generation; testability transformation; system testing; REST; TEST DATA GENERATION; SYMBOLIC EXECUTION; SOFTWARE; SUITE;
D O I
10.1145/3477271
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Search-based software testing (SBST) has been shown to be an effective technique to generate test cases automatically. Its effectiveness strongly depends on the guidance of the fitness function. Unfortunately, a common issue in SBST is the so-called flag problem, where the fitness landscape presents a plateau that provides no guidance to the search. In this article, we provide a series of novel testability transformations aimed at providing guidance in the context of commonly used API calls (e.g., strings that need to be converted into valid date/time objects). We also provide specific transformations aimed at helping the testing of REST Web Services. We implemented our novel techniques as an extension to EvoMaster, an SBST tool that generates system-level test cases. Experiments on nine open-source REST web services, as well as an industrial web service, show that our novel techniques improve performance significantly.
引用
收藏
页数:34
相关论文
共 50 条
  • [31] Automated Refactoring of ATL Model Transformations: A Search-Based Approach
    Alkhazi, Bader
    Ruas, Terry
    Kessentini, Marouane
    Wimmer, Manuel
    Grosky, William, I
    19TH ACM/IEEE INTERNATIONAL CONFERENCE ON MODEL DRIVEN ENGINEERING LANGUAGES AND SYSTEMS (MODELS'16), 2016, : 295 - 304
  • [32] State of Art in the field of Search-based Mutation Testing
    Jatana, Nishtha
    Rani, Shweta
    Suri, Bharti
    2015 4TH INTERNATIONAL CONFERENCE ON RELIABILITY, INFOCOM TECHNOLOGIES AND OPTIMIZATION (ICRITO) (TRENDS AND FUTURE DIRECTIONS), 2015,
  • [33] Search-Based Temporal Testing in an Embedded Multicore Platform
    Srivisut, Komsan
    Clark, John A.
    Paige, Richard F.
    APPLICATIONS OF EVOLUTIONARY COMPUTATION, EVOAPPLICATIONS 2018, 2018, 10784 : 794 - 809
  • [34] Effectiveness Assessment of the Search-Based Statistical Structural Testing
    Shi, Yang
    Song, Xiaoyu
    Perkowski, Marek
    Li, Fu
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 70 (02): : 2191 - 2207
  • [35] Search-based Testing for Accurate Fault Localization in CPS
    Bartocci, Ezio
    Mariani, Leonardo
    Nickovic, Dejan
    Yadav, Drishti
    2022 IEEE 33RD INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING (ISSRE 2022), 2022, : 145 - 156
  • [36] Defect Prediction Guided Search-Based Software Testing
    Perera, Anjana
    Aleti, Aldeida
    Bohme, Marcel
    Turhan, Burak
    2020 35TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE 2020), 2020, : 448 - 460
  • [37] The Maturation of Search-Based Software Testing: Successes and Challenges
    Cohen, Myra B.
    2019 IEEE/ACM 12TH INTERNATIONAL WORKSHOP ON SEARCH-BASED SOFTWARE TESTING (SBST 2019), 2019, : 13 - 14
  • [38] Search-based Performance Testing of Applications with Composite Services
    Gu, Yuanyan
    Ge, Yujia
    WISM: 2009 INTERNATIONAL CONFERENCE ON WEB INFORMATION SYSTEMS AND MINING, PROCEEDINGS, 2009, : 320 - 324
  • [39] Search-based testing using constraint-based mutation
    Malburg, Jan
    Fraser, Gordon
    SOFTWARE TESTING VERIFICATION & RELIABILITY, 2014, 24 (06): : 472 - 495
  • [40] An extensive evaluation of search-based software testing: a review
    Khari, Manju
    Kumar, Prabhat
    SOFT COMPUTING, 2019, 23 (06) : 1933 - 1946