Test Suite Parallelization in Open-Source Projects: A Study on Its Usage and Impact

被引:0
|
作者
Candido, Jeanderson [1 ]
Melo, Luis [1 ]
d'Amorim, Marcelo [1 ]
机构
[1] Univ Fed Pernambuco, Recife, PE, Brazil
关键词
SELECTION;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Dealing with high testing costs remains an important problem in Software Engineering. Test suite parallelization is an important approach to address this problem. This paper reports our findings on the usage and impact of test suite parallelization in open-source projects. It provides recommendations to practitioners and tool developers to speed up test execution. Considering a set of 468 popular Java projects we analyzed, we found that 24% of the projects contain costly test suites but parallelization features still seem underutilized in practice-only 19.1% of costly projects use parallelization. The main reported reason for adoption resistance was the concern to deal with concurrency issues. Results suggest that, on average, developers prefer high predictability than high performance in running tests.
引用
收藏
页码:838 / 848
页数:11
相关论文
共 50 条
  • [1] Test suite parallelization in open-source projects: A study on its usage and impact
    Federal University of Pernambuco, Pernambuco, Brazil
    [J]. ASE - Proc. IEEE/ACM Int. Conf. Autom. Softw. Eng., (838-848):
  • [2] An Exploratory Study on the Usage of Gherkin Features in Open-Source Projects
    Chandorkar, Adwait
    Patkar, Nitish
    Di Sorbo, Andrea
    Nierstrasz, Oscar
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION AND REENGINEERING (SANER 2022), 2022, : 1159 - 1166
  • [3] Usage, Costs, and Benefits of Continuous Integration in Open-Source Projects
    Hilton, Michael
    Tunnell, Timothy
    Huang, Kai
    Marinov, Darko
    Dig, Danny
    [J]. 2016 31ST IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING (ASE), 2016, : 426 - 437
  • [4] A Credential Usage Study: Flow-Aware Leakage Detection in Open-Source Projects
    Han, Ruidong
    Gong, Huihui
    Ma, Siqi
    Li, Juanru
    Xu, Chang
    Bertino, Elisa
    Nepal, Surya
    Ma, Zhuo
    Ma, Jianfeng
    [J]. IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 722 - 734
  • [5] Investigating Developers' Contributions to Test Smell Survivability: A Study of Open-Source Projects
    Campos, Denivan
    Martins, Luana
    Bezerra, Carla
    Machado, Ivan
    [J]. PROCEEDINGS OF THE 8TH BRAZILIAN SYMPOSIUM ON SYSTEMATIC AND AUTOMATED SOFT-WARE TESTING, SAST 2023, 2023, : 86 - 95
  • [6] Evolution Impact on Architecture Stability in Open-Source Projects
    Alenezi, Mamdouh
    Khellah, Fakhry
    [J]. INTERNATIONAL JOURNAL OF CLOUD APPLICATIONS AND COMPUTING, 2015, 5 (04) : 24 - 35
  • [7] Mock Objects in Software Testing: An Analysis of Usage in Open-Source Projects
    de Almeida, Raphael Silva
    da Silva, Romulo Martins
    Serrano, Lucas Silveira
    Campos Junior, Heleno de S.
    Neves, Vania de Oliveira
    [J]. PROCEEDINGS OF THE 22TH BRAZILIAN SYMPOSIUM ON SOFTWARE QUALITY, 2023, : 72 - 79
  • [8] Automatic test improvement with DSpot: a study with ten mature open-source projects
    Benjamin Danglot
    Oscar Luis Vera-Pérez
    Benoit Baudry
    Martin Monperrus
    [J]. Empirical Software Engineering, 2019, 24 : 2603 - 2635
  • [9] Automatic test improvement with DSpot: a study with ten mature open-source projects
    Danglot, Benjamin
    Vera-Perez, Oscar Luis
    Baudry, Benoit
    Monperrus, Martin
    [J]. EMPIRICAL SOFTWARE ENGINEERING, 2019, 24 (04) : 2603 - 2635
  • [10] An Exploratory Study of the Impact of Parameterization on JMH Measurement Results in Open-Source Projects
    Samoaa, Hazem
    Leitner, Philipp
    [J]. PROCEEDINGS OF THE ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING (ICPE '21), 2021, : 213 - 224