Understanding experiments and research practices for reproducibility: an exploratory study

被引:17
|
作者
Samuel, Sheeba [1 ]
Koenig-Ries, Birgitta
机构
[1] Friedrich Schiller Univ Jena, Heinz Nixdorf Chair Distributed Informat Syst, Jena, Germany
来源
PEERJ | 2021年 / 9卷
关键词
Reproducibility; Reproducible research recommendations; Experiments; Reuse; Understandability; Research data lifecycle; Reproducibility crisis; FAIR data principles; SCIENCE; STANDARDS; QUALITY; CRISIS;
D O I
10.7717/peerj.11140
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Scientific experiments and research practices vary across disciplines. The research practices followed by scientists in each domain play an essential role in the understandability and reproducibility of results. The "Reproducibility Crisis'', where researchers find difficulty in reproducing published results, is currently faced by several disciplines. To understand the underlying problem in the context of the reproducibility crisis, it is important to first know the different research practices followed in their domain and the factors that hinder reproducibility. We performed an exploratory study by conducting a survey addressed to researchers representing a range of disciplines to understand scientific experiments and research practices for reproducibility. The survey findings identify a reproducibility crisis and a strong need for sharing data, code, methods, steps, and negative and positive results. Insufficient metadata, lack of publicly available data, and incomplete information in study methods are considered to be the main reasons for poor reproducibility. The survey results also address a wide number of research questions on the reproducibility of scientific results. Based on the results of our explorative study and supported by the existing published literature, we offer general recommendations that could help the scientific community to understand, reproduce, and reuse experimental data and results in the research data lifecycle.
引用
收藏
页数:26
相关论文
共 50 条
  • [21] AN EXPLORATORY STUDY OF ENTERPRISE ARCHITECTURE PRACTICES IN MALAYSIA
    Razak, Rafidah Abd
    Dahalin, Zulkhairi Md.
    [J]. INNOVATION AND KNOWLEDGE MANAGEMENT IN BUSINESS GLOBALIZATION: THEORY & PRACTICE, VOLS 1 AND 2, 2008, : 985 - 989
  • [22] Best Practices in Road Transport: An Exploratory Study
    Fernandez Vazquez-Noguerol, Mar
    Gonzalez-Boubeta, Ivan
    Dominguez-Caamano, Pablo
    Carlos Prado-Prado, Jose
    [J]. JOURNAL OF INDUSTRIAL ENGINEERING AND MANAGEMENT-JIEM, 2018, 11 (02): : 250 - 261
  • [23] Policies and practices in cold cases: an exploratory study
    Davis, Robert C.
    Jensen, Carl
    Kuykendall, Lorrianne
    Gallagher, Kristin
    [J]. POLICING-AN INTERNATIONAL JOURNAL OF POLICE STRATEGIES & MANAGEMENT, 2015, 38 (04) : 610 - 630
  • [24] An exploratory study of knowledge management practices in romanian universities within the unikm academic research consortium
    Baban, Calin Florin
    Baban, Marius
    [J]. Metalurgia International, 2010, 15 (SPEC. ISSUE 9): : 157 - 162
  • [25] AN EXPLORATORY STUDY OF KNOWLEDGE MANAGEMENT PRACTICES IN ROMANIAN UNIVERSITIES WITHIN THE UNIKM ACADEMIC RESEARCH CONSORTIUM
    Baban, Calin Florin
    Baban, Marius
    [J]. METALURGIA INTERNATIONAL, 2010, 15 : 157 - 162
  • [26] An Exploratory Study of Operations Management Best Practices
    Mustafar, Mastora
    Rasli, Amran
    Arshad, Azlin Shafinaz Mohamad
    Norhalim, Nadhirah
    [J]. JURNAL TEKNOLOGI, 2013, 64 (03):
  • [27] Educational Practices for a New Nigeria: An Exploratory Study
    Aydin, Hasan
    Lafer, Stephen
    [J]. ALBERTA JOURNAL OF EDUCATIONAL RESEARCH, 2015, 61 (02): : 126 - 146
  • [28] Reproducibility of Neurography - Exploratory Examination
    Buchner, Helmut
    Schoenlau, Lars
    [J]. KLINISCHE NEUROPHYSIOLOGIE, 2019, 50 (02) : 83 - 88
  • [29] Understanding Energy Practices: A Case for Qualitative Research
    Schelly, Chelsea
    [J]. SOCIETY & NATURAL RESOURCES, 2016, 29 (06) : 744 - 749
  • [30] Assessment Center Practices in Indonesia: An exploratory study
    Krause, Diana E.
    Anderson, Neil
    Rossberger, Robert J.
    Parastuty, Zulaicha
    [J]. INTERNATIONAL JOURNAL OF SELECTION AND ASSESSMENT, 2014, 22 (04) : 384 - 398