Generating expected results for automated black-box testing

被引：30
|
作者：
Schroeder, PJ [1 ]
Faherty, P [1 ]
Korel, B [1 ]
机构：
[1] Univ Wisconsin, Dept Elect Engn Comp Sci, Milwaukee, WI 53201 USA
来源：
ASE 2002: 17TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING | 2002年
关键词：
D O I：
10.1109/ASE.2002.1115005
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper we describe a technique for generating expected results for automated black-box testing. Generating expected results allows larger automated test suites to be created, moving us toward continuous product testing. Our technique uses a program's Input-Output (10) relationships, to identify unique combinations of program inputs that influence program outputs. With this information, a small set of test cases is executed and checked for correctness. Given the correctness of this set, the expected results for the larger combinatorial test set can be generated automatically. Included in the paper is an experimental study in which checking the results of 384 test cases allows us to generate expected results and fully automate nearly 600,000 test cases.
引用
收藏
页码：139 / 148
页数：10
相关论文
共 50 条
  • [1] FACTS: Automated Black-Box Testing of FinTech Systems
    Wang, Qingshun
    Gu, Lintao
    Xue, Minhui
    Xu, Lihua
    Niu, Wenyu
    Dou, Liang
    He, Liang
    Xie, Tao
    [J]. ESEC/FSE'18: PROCEEDINGS OF THE 2018 26TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING, 2018, : 839 - 844
  • [2] RESTTESTGEN: Automated Black-Box Testing of RESTful APIs
    Viglianisi, Emanuele
    Dallago, Michael
    Ceccato, Mariano
    [J]. 2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VALIDATION AND VERIFICATION (ICST 2020), 2020, : 142 - 152
  • [3] Automated black-box testing with abstract VDM oracles
    Aichernig, BK
    [J]. COMPUTER SAFETY, RELIABILITY AND SECURITY, 1999, 1698 : 250 - 259
  • [4] RESTest: Automated Black-Box Testing of RESTful Web APIs
    Martin-Lopez, Alberto
    Segura, Sergio
    Ruiz-Cortes, Antonio
    [J]. ISSTA '21: PROCEEDINGS OF THE 30TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON SOFTWARE TESTING AND ANALYSIS, 2021, : 682 - 685
  • [5] A low budget approach to distributed automated black-box testing
    Boklund, A
    Selvefors, C
    [J]. SERP '05: PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING RESEARCH AND PRACTICE, VOLS 1 AND 2, 2005, : 302 - 308
  • [6] Generating Test Data for Black-Box Testing using Genetic Algorithms
    Fischer, Marten
    Toenjes, Ralf
    [J]. 2012 IEEE 17TH CONFERENCE ON EMERGING TECHNOLOGIES & FACTORY AUTOMATION (ETFA), 2012,
  • [7] State of the Art: Automated Black-Box Web Application Vulnerability Testing
    Bau, Jason
    Bursztein, Elie
    Gupta, Divij
    Mitchell, John
    [J]. 2010 IEEE SYMPOSIUM ON SECURITY AND PRIVACY, 2010, : 332 - 345
  • [8] Automated Requirements-Based Testing of Black-Box Reactive Systems
    Narizzano, Massimo
    Pulina, Luca
    Tacchella, Armando
    Vuotto, Simone
    [J]. NASA FORMAL METHODS (NFM 2020), 2020, 12229 : 153 - 169
  • [9] Automated black-box testing of nominal and error scenarios in RESTful APIs
    Corradini, Davide
    Zampieri, Amedeo
    Pasqua, Michele
    Viglianisi, Emanuele
    Dallago, Michael
    Ceccato, Mariano
    [J]. SOFTWARE TESTING VERIFICATION & RELIABILITY, 2022, 32 (05):
  • [10] RestTestGen: An Extensible Framework for Automated Black-box Testing of RESTful APIs
    Corradini, Davide
    Zampieri, Amedeo
    Pasqua, Michele
    Ceccato, Mariano
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE MAINTENANCE AND EVOLUTION (ICSME 2022), 2022, : 504 - 508
12345