Combinatorial Robustness Testing with Negative Test Cases

被引:5
|
作者
Foegen, Konrad [1 ]
Lichter, Horst [1 ]
机构
[1] Rhein Westfal TH Aachen, Res Grp Software Construct, Aachen, Nrw, Germany
关键词
Software Testing; Test Generation; Combinatorial Testing; Robustness Testing;
D O I
10.1109/QRS.2019.00018
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Error-handling is an important means to improve the robustness of a system and testing error-handling is crucial to ensure its correctness. In this paper, we argue that error-handling leads to input masking which requires special treatment in for combinatorial testing. Therefore, we propose an extension to combinatorial testing including a robustness fault model and robustness combination strategy. We also provide an evaluation which compares its efficiency to normal combinatorial testing.
引用
收藏
页码:34 / 45
页数:12
相关论文
共 50 条
  • [1] Combinatorial Testing with Constraints for Negative Test Cases
    Foegen, Konrad
    Lichter, Horst
    [J]. 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW), 2018, : 328 - 331
  • [2] Generation of Invalid Test Inputs from Over-Constrained Test Models for Combinatorial Robustness Testing
    Foegen, Konrad
    Lichter, Horst
    [J]. 2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW), 2020, : 171 - 180
  • [3] Test Algebra for Combinatorial Testing
    Tsai, Wei-Tek
    Colbourn, Charles J.
    Luo, Jie
    Qi, Guanqiu
    Li, Qingyang
    Bai, Xiaoying
    [J]. 2013 8TH INTERNATIONAL WORKSHOP ON AUTOMATION OF SOFTWARE TEST (AST), 2013, : 19 - 25
  • [4] Combinatorial testing: using blocking to assign test cases for validating complex software systems
    Lekivetz, Ryan
    Morgan, Joseph
    [J]. STATISTICAL THEORY AND RELATED FIELDS, 2021, 5 (02) : 114 - 121
  • [5] Integrated Test Environment for Combinatorial Testing
    Patil, Abhinandan H.
    Satish, Preeti
    Goveas, Neena
    Rangarajan, Krishnan
    [J]. 2015 IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC), 2015, : 726 - 729
  • [6] Repairing Over-Constrained Models for Combinatorial Robustness Testing
    Foegen, Konrad
    Lichter, Horst
    [J]. 2019 COMPANION OF THE 19TH IEEE INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY (QRS-C 2019), 2019, : 177 - 184
  • [7] Test Oracles and Test Script Generation in Combinatorial Testing
    Kruse, Peter M.
    [J]. 2016 IEEE NINTH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW), 2016, : 75 - 82
  • [8] Cascade: a Test Generation Tool for Combinatorial Testing
    Zhao, Yong
    Zhang, Zhiqiang
    Yan, Jun
    Zhang, Jian
    [J]. IEEE SIXTH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW 2013), 2013, : 267 - 270
  • [9] A hybrid test prioritisation technique for combinatorial testing
    Satish, Preeti
    Rangarajan, Krishnan
    [J]. International Journal of Intelligent Systems Technologies and Applications, 2019, 18 (1-2): : 84 - 100
  • [10] Concurrent Test Algebra Execution with Combinatorial Testing
    Tsai, Wei-Tek
    Luo, Jie
    Qi, Guanqiu
    Wu, Wenjun
    [J]. 2014 IEEE 8TH INTERNATIONAL SYMPOSIUM ON SERVICE ORIENTED SYSTEM ENGINEERING (SOSE), 2014, : 35 - 46