Selective reporting of placebo tests in top economics journals

被引：3

作者：

Dreber, Anna ^{[1
,2
,3
]}

Johannesson, Magnus ^{[1
]}

Yang, Yifan ^{[1
]}

机构：

[1] Stockholm Sch Econ, Dept Econ, Stockholm, Sweden

[2] Univ Innsbruck, Dept Econ, Innsbruck, Austria

[3] Stockholm Sch Econ, Dept Econ, POB 6501, S-11383 Stockholm, Sweden

来源：

ECONOMIC INQUIRY | 2024年 / 62卷 / 03期

关键词：

metascience; placebo tests; underreporting; PUBLICATION BIAS; CREDIT; CRISIS; INCOME;

D O I：

10.1111/ecin.13217

中图分类号：

F [经济];

学科分类号：

02 ;

摘要：

Placebo tests provide incentives to underreport statistically significant tests, a form of reversed p-hacking. We test for such underreporting in 11 top economics journals between 2009 and 2021 based on a pre-registered analysis plan. If the null hypothesis is true in all tests, 2.5% of them should be significant at the 5% level with an effect in the same direction as the main test (and 5% in total). The actual fraction of statistically significant placebo tests with an effect in the same direction is 1.29% (95% CI [0.83, 1.63]), and the overall fraction of statistically significant placebo tests is 3.10% (95% CI [2.2, 4.0]).

引用

页码：921 / 932

页数：12

共 50 条

[41] The economics of ecology journals
Bergstrom, Carl T.
Bergstrom, Theodore C.
FRONTIERS IN ECOLOGY AND THE ENVIRONMENT, 2006, 4 (09) : 488 - 495
[42] Core journals in economics
Liner, GH
ECONOMIC INQUIRY, 2002, 40 (01) : 138 - 145
[43] THE CORE JOURNALS OF ECONOMICS
DIAMOND, AM
CURRENT CONTENTS, 1989, 1 : 4 - 11
[44] THE ECONOMICS OF LEARNED JOURNALS
CROSS, N
TLS-THE TIMES LITERARY SUPPLEMENT, 1984, (4260): : 1348 - 1348
[45] The economics of electronic journals
Odlyzko, A
TECHNOLOGY AND SCHOLARLY COMMUNICATION, 1999, : 380 - 393
[46] The reporting of ethical approval and informed consent in the top five surgical and colorectal journals by impact factor
Murphy, S. P.
Rice, C.
Lawlor, A.
Kieswetter, L.
O'Rourke, C.
Fenton, J. E.
Coffey, J. C.
IRISH JOURNAL OF MEDICAL SCIENCE, 2015, 184 : S178 - S178
[47] Transparency in literature reviews: an assessment of reporting practices across review types and genres in top IS journals
Templier, Mathieu
Pare, Guy
EUROPEAN JOURNAL OF INFORMATION SYSTEMS, 2018, 27 (05) : 503 - 550
[48] Low Rates of Reporting Race, Ethnicity, and Socioeconomic Status in Studies Published in Top Orthopaedic Journals
Crnkovic, Cody
Quiring, Robert
Chapple, Andrew G.
Bronstone, Amy
Krause, Peter C.
Dasa, Vinod
JOURNAL OF BONE AND JOINT SURGERY-AMERICAN VOLUME, 2022, 104 (14): : 1244 - 1249
[49] Reporting quality of abstracts of trials published in top five pain journals: a protocol for a systematic survey
Sriganesh, Kamath
Bharadwaj, Suparna
Wang, Mei
Abbade, Luciana P. F.
Couban, Rachel
Mbuagbaw, Lawrence
Thabane, Lehana
BMJ OPEN, 2016, 6 (11):
[50] Normative versus strategic accounts of acknowledgment data: The case of the top-five journals of economics
Alberto Baccini
Eugenio Petrovich
Scientometrics, 2022, 127 : 603 - 635

← 1 2 3 4 5 →