RESTest: Automated Black-Box Testing of RESTful Web APIs

被引:29
|
作者
Martin-Lopez, Alberto [1 ]
Segura, Sergio [1 ]
Ruiz-Cortes, Antonio [1 ]
机构
[1] Univ Seville, I3US Inst, SCORE Lab, Seville, Spain
关键词
REST; black-box testing; web APIs;
D O I
10.1145/3460319.3469082
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Testing RESTful APIs thoroughly is critical due to their key role in software integration. Existing tools for the automated generation of test cases in this domain have shown great promise, but their applicability is limited as they mostly rely on random inputs, i.e., fuzzing. In this paper, we present RESTest, an open source blackbox testing framework for RESTful web APIs. Based on the API specification, RESTest supports the generation of test cases using different testing techniques such as fuzzing and constraint-based testing, among others. RESTest is developed as a framework and can be easily extended with new test case generators and test writers for different programming languages. We evaluate the tool in two scenarios: offline and online testing. In the former, we show how RESTest can efficiently generate realistic test cases (test inputs and test oracles) that uncover bugs in real-world APIs. In the latter, we show RESTest's capabilities as a continuous testing and monitoring framework. Demo video: https://youtu.be/1f_tjdkaCKo.
引用
收藏
页码:682 / 685
页数:4
相关论文
共 50 条
  • [1] RESTest: Black-Box Constraint-Based Testing of RESTful Web APIs
    Martin-Lopez, Alberto
    Segura, Sergio
    Ruiz-Cortes, Antonio
    [J]. SERVICE-ORIENTED COMPUTING (ICSOC 2020), 2020, 12571 : 459 - 475
  • [2] RESTTESTGEN: Automated Black-Box Testing of RESTful APIs
    Viglianisi, Emanuele
    Dallago, Michael
    Ceccato, Mariano
    [J]. 2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VALIDATION AND VERIFICATION (ICST 2020), 2020, : 142 - 152
  • [3] RestTestGen: An Extensible Framework for Automated Black-box Testing of RESTful APIs
    Corradini, Davide
    Zampieri, Amedeo
    Pasqua, Michele
    Ceccato, Mariano
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION (ICSME 2022), 2022, : 504 - 508
  • [4] Automated Black-box Testing of Mass Assignment Vulnerabilities in RESTful APIs
    Corradini, Davide
    Pasqua, Michele
    Ceccato, Mariano
    [J]. 2023 IEEE/ACM 45TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ICSE, 2023, : 2553 - 2564
  • [5] Automated black-box testing of nominal and error scenarios in RESTful APIs
    Corradini, Davide
    Zampieri, Amedeo
    Pasqua, Michele
    Viglianisi, Emanuele
    Dallago, Michael
    Ceccato, Mariano
    [J]. SOFTWARE TESTING VERIFICATION & RELIABILITY, 2022, 32 (05):
  • [6] Automated Black- and White-Box Testing of RESTful APIs With EvoMaster
    Arcuri, Andrea
    [J]. IEEE SOFTWARE, 2021, 38 (03) : 72 - 78
  • [7] Empirical Comparison of Black-box Test Case Generation Tools for RESTful APIs
    Corradini, Davide
    Zampieri, Amedeo
    Pasqua, Michele
    Ceccato, Mariano
    [J]. IEEE 21ST INTERNATIONAL WORKING CONFERENCE ON SOURCE CODE ANALYSIS AND MANIPULATION (SCAM 2021), 2021, : 226 - 236
  • [8] foREST: A Tree-based Black-box Fuzzing Approach for RESTful APIs
    Lin, Jiaxian
    Li, Tianyu
    Chen, Yang
    Wei, Guangsheng
    Lin, Jiadong
    Zhang, Sen
    Xu, Hui
    [J]. 2023 IEEE 34TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING, ISSRE, 2023, : 695 - 705
  • [9] State of the Art: Automated Black-Box Web Application Vulnerability Testing
    Bau, Jason
    Bursztein, Elie
    Gupta, Divij
    Mitchell, John
    [J]. 2010 IEEE SYMPOSIUM ON SECURITY AND PRIVACY, 2010, : 332 - 345
  • [10] Testing of RESTful Web APIs
    Martin-Lopez, Alberto
    Alonso, Juan C.
    [J]. SERVICE-ORIENTED COMPUTING - ICSOC 2022 WORKSHOPS, 2023, 13821 : 411 - 413