Test coverage criteria for software product line testing: Systematic literature review

被引:15
|
作者
Lee, Jihyun [1 ]
Kang, Sungwon [2 ]
Jung, Pilsu [2 ]
机构
[1] Jeonbuk Natl Univ, Dept Software Engn, 567 Baekje Daero, Jeonju Si, South Korea
[2] Korea Adv Inst Sci & Technol, Sch Comp, 291 Daehak Ro, Daejeon, South Korea
基金
新加坡国家研究基金会;
关键词
Software product line; Software product line testing; Test coverage; Test coverage criteria;
D O I
10.1016/j.infsof.2020.106272
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Context: In software product line testing (SPLT), test coverage criterion is an important concept, as it provides a means of measuring the extent to which domain testing has been performed and redundant application testing can be avoided based on the test coverage level achieved in domain testing. However, no previous literature reviews on SPLT have addressed test coverage criterion in SPLT. Objective: The objectives of this paper are as follows: (1) to clarify the notions of test basis and test coverage criterion for SPLT; (2) to identify the test coverage criteria currently used for SPLT; (3) to investigate how various SPLT aspects, such as the SPLT method, variability implementation mechanism, and variability management approach, affect the choice of test coverage criterion for SPLT; and (4) to analyze the limitations of test coverage criteria currently used for SPLT. Method: This paper conducts a systematic review of test coverage criteria in SPLT with 78 selected studies. Results: We have several findings that can guide the future research on SPLT. One important finding is that choice of test coverage criterion in SPLT is independent from variability implementation mechanism, variability management, SPL approach, and binding time but is dependent on the variability representation used in development artifacts. Another that is easily overlooked is that SPL test coverage criteria with the same test coverage criterion names of single system testing neither adequately convey what should be covered by the test methods applying them, nor can they be more generally regarded as extensions or generalizations for SPLT of their corresponding test coverage criteria of single system testing. Conclusion: This study showed that SPL test coverage criteria should be defined or redefined so that they can clearly deliver the target properties to be satisfied by SPLT.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Software product line testing: a systematic literature review
    Agh, Halimeh
    Azamnouri, Aidin
    Wagner, Stefan
    [J]. EMPIRICAL SOFTWARE ENGINEERING, 2024, 29 (06)
  • [2] A Systematic Literature Review of Test Case Prioritization Technique on Software Product Line Testing
    Shareef, Siti Hawa Mohamed
    Sulaiman, Rabatul Aduni
    Basari, Abd Samad Hasan
    [J]. KSII Transactions on Internet and Information Systems, 2024, 18 (10): : 2872 - 2894
  • [3] SOFTWARE PRODUCT LINE TESTING A Systematic Review
    Perez Lamancha, Beatriz
    Polo Usaola, Macario
    Piattini Velthius, Mario
    [J]. ICSOFT 2009: PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON SOFTWARE AND DATA TECHNOLOGIES, VOL 1, 2009, : 23 - +
  • [4] A SYSTEMATIC LITERATURE REVIEW ON SOFTWARE PRODUCT LINE QUALITY
    Moraga, Carmen
    Moraga, Ma Angeles
    Genero, Marcela
    Piattini, Mario
    [J]. ICSOFT 2011: PROCEEDINGS OF THE 6TH INTERNATIONAL CONFERENCE ON SOFTWARE AND DATABASE TECHNOLOGIES, VOL 2, 2011, : 269 - 272
  • [5] Software product line evolution: A systematic literature review
    Marques, Maira
    Simmonds, Jocelyn
    Rossel, Pedro O.
    Cecilia Bastarrica, Maria
    [J]. INFORMATION AND SOFTWARE TECHNOLOGY, 2019, 105 : 190 - 208
  • [6] Software product line scoping: A systematic literature review
    Marchezan, Luciano
    Rodrigues, Elder
    Guez Assuncao, Wesley Klewerton
    Bernardino, Maicon
    Basso, Fabio Paulo
    Carbonell, Joao
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2022, 186
  • [7] Software product line scoping: A systematic literature review
    Marchezan, Luciano
    Rodrigues, Elder
    Assunção, Wesley K. G.
    Bernardino, Maicon
    Basso, Fábio Paulo
    Carbonell, João
    [J]. 26th ACM International Systems and Software Product Line Conference, SPLC 2022 - Proceedings, 2022, A
  • [8] Reverse Engineering in Software Product Line - A Systematic Literature Review
    Hasbi, Muhamad
    Budiardjo, Eko K.
    Wibowo, Wahyu C.
    [J]. PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 174 - 179
  • [9] On strategies for testing software product lines: A systematic literature review
    Machado, Ivan do Carmo
    McGregor, John D.
    Cavalcanti, Yguarata Cerqueira
    de Almeida, Eduardo Santana
    [J]. INFORMATION AND SOFTWARE TECHNOLOGY, 2014, 56 (10) : 1183 - 1199
  • [10] Empirical software product line engineering: A systematic literature review
    Eva Chacon-Luna, Ana
    Manuel Gutierrez, Antonio
    Galindo, Jose A.
    Benavides, David
    [J]. INFORMATION AND SOFTWARE TECHNOLOGY, 2020, 128