Opportunities for increased reproducibility and replicability of developmental neuroimaging

被引:48
|
作者
Klapwijk, Eduard T. [1 ,2 ,3 ]
van den Bos, Wouter [4 ,5 ]
Tamnes, Christian K. [6 ,7 ,8 ,9 ]
Raschle, Nora M. [10 ]
Mills, Kathryn L. [6 ,11 ]
机构
[1] Erasmus Univ, Erasmus Sch Social & Behav Sci, Burgemeester Oudlaan 50, NL-3062 PA Rotterdam, Netherlands
[2] Leiden Univ, Inst Psychol, Leiden, Netherlands
[3] Leiden Inst Brain & Cognit, Leiden, Netherlands
[4] Univ Amsterdam, Dept Psychol, Amsterdam, Netherlands
[5] Max Planck Inst Human Dev, Ctr Adapt Rat, Berlin, Germany
[6] Univ Oslo, Dept Psychol, PROMENTA Res Ctr, Oslo, Norway
[7] Oslo Univ Hosp, Div Mental Hlth & Addict, NORMENT, Oslo, Norway
[8] Univ Oslo, Inst Clin Med, Oslo, Norway
[9] Diakonhjemmet Hosp, Dept Psychiat, Oslo, Norway
[10] Univ Zurich, Jacobs Ctr Prod Youth Dev, Zurich, Switzerland
[11] Univ Oregon, Dept Psychol, Eugene, OR 97403 USA
基金
欧洲研究理事会;
关键词
Development; Open science; Sample size; Cognitive neuroscience; Transparency; Preregistration; PROSPECTIVE MOTION CORRECTION; GENDERED CITATION PATTERNS; TEST-RETEST RELIABILITY; HEAD MOTION; SAMPLE-SIZE; BRAIN-DEVELOPMENT; POWER FAILURE; QUALITY; FMRI; ADOLESCENCE;
D O I
10.1016/j.dcn.2020.100902
中图分类号
B844 [发展心理学(人类心理学)];
学科分类号
040202 ;
摘要
Many workflows and tools that aim to increase the reproducibility and replicability of research findings have been suggested. In this review, we discuss the opportunities that these efforts offer for the field of developmental cognitive neuroscience, in particular developmental neuroimaging. We focus on issues broadly related to statistical power and to flexibility and transparency in data analyses. Critical considerations relating to statistical power include challenges in recruitment and testing of young populations, how to increase the value of studies with small samples, and the opportunities and challenges related to working with large-scale datasets. Developmental studies involve challenges such as choices about age groupings, lifespan modelling, analyses of longitudinal changes, and data that can be processed and analyzed in a multitude of ways. Flexibility in data acquisition, analyses and description may thereby greatly impact results. We discuss methods for improving transparency in developmental neuroimaging, and how preregistration can improve methodological rigor. While outlining challenges and issues that may arise before, during, and after data collection, solutions and resources are highlighted aiding to overcome some of these. Since the number of useful tools and techniques is evergrowing, we highlight the fact that many practices can be implemented stepwise.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] An Inspection of the Reproducibility and Replicability of TCT-ColBERT
    Wang, Xiao
    MacAvaney, Sean
    Macdonald, Craig
    Ounis, Iadh
    PROCEEDINGS OF THE 45TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '22), 2022, : 2790 - 2800
  • [32] GeoAI Reproducibility and Replicability: A Computational and Spatial Perspective
    Li, Wenwen
    Hsu, Chia-Yu
    Wang, Sizhe
    Kedron, Peter
    ANNALS OF THE AMERICAN ASSOCIATION OF GEOGRAPHERS, 2024, 114 (09) : 2085 - 2103
  • [33] Reproducibility and replicability in zebrafish behavioral neuroscience research
    Gerlai, Robert
    PHARMACOLOGY BIOCHEMISTRY AND BEHAVIOR, 2019, 178 : 30 - 38
  • [34] Reproducibility and replicability of software defect prediction studies
    Mahmood, Zaheed
    Bowes, David
    Hall, Tracy
    Lane, Peter C. R.
    Petric, Jean
    INFORMATION AND SOFTWARE TECHNOLOGY, 2018, 99 : 148 - 163
  • [36] On the Reproducibility and Replicability of Deep Learning in Software Engineering
    Liu, Chao
    Gao, Cuiyun
    Xia, Xin
    Lo, David
    Grundy, John
    Yang, Xiaohu
    ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2022, 31 (01)
  • [37] Reproducibility and replicability of rodent phenotyping in preclinical studies
    Kafkafi, Neri
    Agassi, Joseph
    Chesler, Elissa J.
    Crabbe, John C.
    Crusio, Wim E.
    Eilam, David
    Gerlai, Robert
    Goiani, Ilan
    Gomez-Marin, Alex
    Heller, Ruth
    Iraqi, Fuad
    Jaljuli, Iman
    Karp, Natasha A.
    Morgan, Hugh
    Nicholson, George
    Pfaff, Donald W.
    Richter, S. Helene
    Stark, Philip B.
    Stiedl, Oliver
    Stodden, Victoria
    Tarantino, Lisa M.
    Tucci, Valter
    Valdar, William
    Williams, Robert W.
    Wurbel, Hanno
    Benjamini, Yoav
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2018, 87 : 218 - 232
  • [38] Reproducibility and Replicability in the Context of the Contested Identities of Geography
    Sui, Daniel
    Kedron, Peter
    ANNALS OF THE AMERICAN ASSOCIATION OF GEOGRAPHERS, 2021, 111 (05) : 1275 - 1283
  • [39] Reproducibility and replicability in health professions education research
    Ellaway, Rachel H.
    ADVANCES IN HEALTH SCIENCES EDUCATION, 2024, 29 (05) : 1539 - 1544
  • [40] REPLICABILITY, REPRODUCIBILITY, AND ROBUSTNESS - COMMENTS ON COLLINS,HARRY
    CARTWRIGHT, N
    HISTORY OF POLITICAL ECONOMY, 1991, 23 (01) : 143 - 155