Understanding experiments and research practices for reproducibility: an exploratory study

被引:17
|
作者
Samuel, Sheeba [1 ]
Koenig-Ries, Birgitta
机构
[1] Friedrich Schiller Univ Jena, Heinz Nixdorf Chair Distributed Informat Syst, Jena, Germany
来源
PEERJ | 2021年 / 9卷
关键词
Reproducibility; Reproducible research recommendations; Experiments; Reuse; Understandability; Research data lifecycle; Reproducibility crisis; FAIR data principles; SCIENCE; STANDARDS; QUALITY; CRISIS;
D O I
10.7717/peerj.11140
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Scientific experiments and research practices vary across disciplines. The research practices followed by scientists in each domain play an essential role in the understandability and reproducibility of results. The "Reproducibility Crisis'', where researchers find difficulty in reproducing published results, is currently faced by several disciplines. To understand the underlying problem in the context of the reproducibility crisis, it is important to first know the different research practices followed in their domain and the factors that hinder reproducibility. We performed an exploratory study by conducting a survey addressed to researchers representing a range of disciplines to understand scientific experiments and research practices for reproducibility. The survey findings identify a reproducibility crisis and a strong need for sharing data, code, methods, steps, and negative and positive results. Insufficient metadata, lack of publicly available data, and incomplete information in study methods are considered to be the main reasons for poor reproducibility. The survey results also address a wide number of research questions on the reproducibility of scientific results. Based on the results of our explorative study and supported by the existing published literature, we offer general recommendations that could help the scientific community to understand, reproduce, and reuse experimental data and results in the research data lifecycle.
引用
收藏
页数:26
相关论文
共 50 条
  • [31] Reproducibility in Computing Research: An Empirical Study
    Raghupathi, Wullianallur
    Raghupathi, Viju
    Ren, Jie
    [J]. IEEE ACCESS, 2022, 10 : 29207 - 29223
  • [32] INTERACTIVE EXPLORATORY OBJECTS: FROM LABORATORY EXPERIMENTS TO MASS PRACTICES OF THE XXI CENTURY
    Poddiakov, A. N.
    Poddiakov, N. N.
    [J]. PSYCHOLOGY-JOURNAL OF THE HIGHER SCHOOL OF ECONOMICS, 2018, 15 (04): : 656 - 674
  • [33] Between two stools: preclinical research, reproducibility, and statistical design of experiments
    Penny S. Reynolds
    [J]. BMC Research Notes, 15
  • [34] Between two stools: preclinical research, reproducibility, and statistical design of experiments
    Reynolds, Penny S.
    [J]. BMC RESEARCH NOTES, 2022, 15 (01)
  • [35] Boosting reproducible research practices with the Repeat It With Me: Reproducibility Team Challenge
    Bortolotti, Laura
    Schauman, Sophie
    Caligiuri, Maria Eugenia
    [J]. MAGNETIC RESONANCE IN MEDICINE, 2024, 92 (03) : 886 - 889
  • [36] A review and evaluation of exploratory factor analysis practices in organizational research
    Conway, JM
    Huffcutt, AI
    [J]. ORGANIZATIONAL RESEARCH METHODS, 2003, 6 (02) : 147 - 168
  • [37] UK Reproducibility Network open and transparent research practices survey dataset
    Hughes-Noehrer, Lukas
    Aubert Bonn, Noemie
    De Maria, Marcello
    Evans, Thomas Rhys
    Farran, Emily K.
    Fortunato, Laura
    Henderson, Emma L.
    Jacobs, Neil
    Munafo, Marcus R.
    Stewart, Suzanne L. K.
    Stewart, Andrew J.
    [J]. SCIENTIFIC DATA, 2024, 11 (01)
  • [38] Understanding Unlicensed Drug Vendor Practices Related to Childhood Malaria in One Rural District of Uganda: An Exploratory Study
    Liow, Eric
    Kassam, Rosemin
    Sekiwunga, Richard
    [J]. JOURNAL OF TROPICAL MEDICINE, 2018, 2018
  • [39] Understanding Possible Roles of Locally-grown Ethnic Produce in Dietary Practices and Food Cultures: An Exploratory Study
    Goto, Keiko
    Whitten, Jennifer
    Giovanni, Maria
    Wolff, Cindy
    Bianco, Stephanie
    [J]. JOURNAL OF HUNGER & ENVIRONMENTAL NUTRITION, 2016, 11 (01) : 72 - 85
  • [40] Open Access and Reproducibility in Plant Pathology Research: Guidelines and Best Practices
    Grunwald, Niklaus J.
    Bock, Clive H.
    Chang, Jeff H.
    De Souza, Alessandra Alves
    Del Ponte, Emerson M.
    du Toit, Lindsey J.
    Dorrance, Anne E.
    Dung, Jeremiah
    Gent, David
    Goss, Erica M.
    Lowe-Power, Tiffany M.
    Madden, Laurence V.
    Martin, Frank N.
    McDowell, John
    Naegele, Rachel P.
    Potnis, Neha
    Quesada-Ocampo, Lina M.
    Sundin, George W.
    Thiessen, Lindsey
    Vinatzer, Boris A.
    Zeng, Quan
    [J]. PHYTOPATHOLOGY, 2024, 114 (05) : 910 - 916