Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses

被引：3

作者：

Coretta, Stefano ^{[1
]}

Casillas, Joseph V. ^{[2
]}

Roessig, Simon ^{[3
]}

Franke, Michael ^{[4
]}

Ahn, Byron ^{[5
]}

Al-Hoorie, Ali H. ^{[6
]}

Al-Tamimi, Jalal ^{[7
]}

Alotaibi, Najd E. ^{[8
]}

AlShakhori, Mohammed K. ^{[9
]}

Altmiller, Ruth M. ^{[10
]}

Arantes, Pablo ^{[11
]}

Athanasopoulou, Angeliki ^{[12
]}

Baese-Berk, Melissa M. ^{[13
]}

Bailey, George ^{[14
]}

Sangma, Cheman Baira A. ^{[12
]}

Beier, Eleonora J. ^{[15
]}

Benavides, Gabriela M. ^{[9
]}

Benker, Nicole ^{[16
]}

BensonMeyer, Emelia P. ^{[17
]}

Benway, Nina R. ^{[18
]}

Berry, Grant M. ^{[19
]}

Bing, Liwen ^{[20
]}

Bjorndahl, Christina ^{[21
]}

Bolyanatz, Mariska ^{[22
]}

Braver, Aaron ^{[23
]}

Brown, Violet A. ^{[10
]}

Brown, Alicia M. ^{[24
]}

Brugos, Alejna ^{[25
]}

Buchanan, Erin M. ^{[26
]}

Butlin, Tanna ^{[12
]}

Buxo-Lugo, Andres ^{[27
]}

Caillol, Coline

Cangemi, Francesco ^{[28
,29
]}

Carignan, Christopher ^{[30
]}

Carraturo, Sita ^{[10
]}

Caudrelier, Tiphaine ^{[31
]}

Chodroff, Eleanor ^{[14
]}

Cohn, Michelle ^{[32
]}

Cronenberg, Johanna ^{[16
]}

Crouzet, Olivier ^{[33
]}

Dagar, Erica L. ^{[34
,35
]}

Dawson, Charlotte ^{[36
]}

Diantoro, Carissa A. ^{[13
]}

Dokovova, Marie ^{[37
]}

Drake, Shiloh ^{[13
]}

Du, Fengting ^{[38
]}

Dubuis, Margaux ^{[39
]}

Dueme, Florent ^{[31
]}

Durward, Matthew ^{[40
]}

Egurtzegi, Ander ^{[41
]}

机构：

[1] Univ Edinburgh, Dept Linguist & English Language, Edinburgh, Scotland

[2] Rutgers State Univ, Dept Spanish & Portuguese, New Brunswick, NJ USA

[3] Cornell Univ, Dept Linguist, Ithaca, NY USA

[4] Univ Tubingen, Dept Gen & Computat Linguist, Tubingen, Germany

[5] Princeton Univ, Program Linguist, Princeton, NJ USA

[6] Royal Commiss Jubail & Yanbu, Jubail English Language & Preparatory Year Inst, Jubail Ind City, Saudi Arabia

[7] Univ Paris Cite, CNRS, Lab Linguist Formelle, Paris, France

[8] Newcastle Univ, Sch Educ Commun & Language Sci, Newcastle Upon Tyne, England

[9] Univ Arizona, Dept Linguist, Tucson, AZ USA

[10] Washington Univ St Louis, Psychol & Brain Sci, St Louis, MO USA

[11] Univ Fed Sao Carlos, Dept Letras, Sao Carlos, Brazil

[12] Univ Calgary, Sch Languages Linguist Literatures & Cultures, Calgary, AB, Canada

[13] Univ Oregon, Dept Linguist, Eugene, OR USA

[14] Univ York, Dept Language & Linguist Sci, York, England

[15] Univ Calif Davis, Dept Psychol, Davis, CA USA

[16] Univ Munich, Inst Phonet & Speech Proc, Munich, Germany

[17] Univ Penn, Dept Linguist, Philadelphia, PA USA

[18] Syracuse Univ, Dept Commun Sci & Disorders, Syracuse, NY USA

[19] Villanova Univ, Dept Spanish, Villanova, PA USA

[20] Univ Birmingham, Dept English Language & Linguist, Birmingham, England

[21] Carnegie Mellon Univ, Dept Philosophy, Pittsburgh, PA USA

[22] Occidental Coll, Department Spanish & French Studies, Los Angeles, CA USA

[23] Texas Tech Univ, English, Lubbock, TX USA

[24] Univ Arizona, Dept Spanish & Portuguese, Tucson, AZ USA

[25] Simmons Univ, Div Math & Comp Sci, Boston, MA USA

[26] Harrisburg Univ Sci & Technol, Analyt, Harrisburg, PA USA

[27] SUNY Buffalo, Dept Psychol, Buffalo, NY USA

[28] Univ Paris Cite, CLILLAC ARP, Paris, France

[29] Univ Cologne, IfL Phonet, Cologne, Germany

[30] UCL, Dept Speech Hearing & Phonet Sci, London, England

[31] Basque Ctr Cognit Brain & Language, Donostia San Sebastian, Spain

[32] Univ Calif Davis, Dept Linguist, Davis, CA USA

[33] Univ Nantes, CNRS, Lab Linguist Nantes UMR6310, Nantes, France

[34] Univ Texas Arlington, Dept Linguist, Arlington, TX USA

[35] Univ Texas Arlington, TESOL, Arlington, TX USA

[36] Newcastle Univ, Sch Psychol, Newcastle Upon Tyne, England

[37] Univ Strathclyde, Sch Psychol Sci & Hlth, Glasgow, Scotland

[38] Newcastle Univ, Sch English Literature Language & Linguist, Newcastle Upon Tyne, England

[39] Univ Zurich, Dept Comparat Language Sci, Zurich, Switzerland

[40] Univ Canterbury, Dept Linguist, Christchurch, New Zealand

[41] CNRS, IKER UMR 5478, Bayonne, France

[42] Univ Leicester, Dept Neurosci Psychol & Behav, Leicester, England

[43] Assoc Div Linguist, Stat Grp, Cologne, Germany

[44] Max Planck Inst Empir Aesthet, Dept Mus, Frankfurt, Germany

[45] Pacific Lutheran Univ, Dept Psychol, Washington, DC USA

[46] Univ Laval, Department Languages Linguist & Translat, Quebec City, PQ, Canada

[47] Univ Canterbury, New Zealand Inst Language Brain & Behav, Christchurch, New Zealand

[48] St Louis Univ, Dept Languages Literatures & Cultures, St Louis, MO USA

[49] Princeton Univ, Dept Psychol, Princeton, NJ USA

[50] Aix Marseille Univ, LPC, CNRS, Marseille, France

来源：

ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE | 2023年 / 6卷 / 03期

基金：

欧洲研究理事会;

关键词：

crowdsourcing science; data analysis; scientific transparency; speech; acoustic analysis; FOCUS; TRANSPARENCY; REPLICATIONS; CREDIBILITY; PSYCHOLOGY; JUDGMENT; ENGLISH; SCIENCE; DESIGN; TESTS;

D O I：

10.1177/25152459231162567

中图分类号：

B84 [心理学];

学科分类号：

04 ; 0402 ;

摘要：

Recent empirical studies have highlighted the large degree of analytic flexibility in data analysis that can lead to substantially different conclusions based on the same data set. Thus, researchers have expressed their concerns that these researcher degrees of freedom might facilitate bias and can lead to claims that do not stand the test of time. Even greater flexibility is to be expected in fields in which the primary data lend themselves to a variety of possible operationalizations. The multidimensional, temporally extended nature of speech constitutes an ideal testing ground for assessing the variability in analytic approaches, which derives not only from aspects of statistical modeling but also from decisions regarding the quantification of the measured behavior. In this study, we gave the same speech-production data set to 46 teams of researchers and asked them to answer the same research question, resulting in substantial variability in reported effect sizes and their interpretation. Using Bayesian meta-analytic tools, we further found little to no evidence that the observed variability can be explained by analysts' prior beliefs, expertise, or the perceived quality of their analyses. In light of this idiosyncratic variability, we recommend that researchers more transparently share details of their analysis, strengthen the link between theoretical construct and quantitative system, and calibrate their (un)certainty in their conclusions.

引用

页数：29

共 2 条

[1] An examination of the degrees of freedom of human jaw motion in speech and mastication
Ostry, DJ
Vatikiotis-Bateson, E
Gribble, PL
[J]. JOURNAL OF SPEECH LANGUAGE AND HEARING RESEARCH, 1997, 40 (06): : 1341 - 1351
[2] Estimating Sample Area Functions of Human Vocal Tracts in Emotional Speech Signals
Choudhury, Nupur
Sharma, Uzzal
[J]. TRAITEMENT DU SIGNAL, 2023, 40 (03) : 875 - 884

← 1 →