Effect of confidence interval construction on judgment accuracy

被引：0

作者：

Mandel, David R. ^{[1
]}

Collins, Robert N. ^{[1
]}

Risko, Evan F. ^{[2
]}

Fugelsang, Jonathan A. ^{[2
]}

机构：

[1] Def Res & Dev Canada, Intelligence Influence & Collaborat Sect, Ottawa, ON, Canada

[2] HumanSystems Inc, Guelph, ON, Canada

来源：

JUDGMENT AND DECISION MAKING | 2020年 / 15卷 / 05期

关键词：

judgment; accuracy; confidence intervals; order effect; EXPERT KNOWLEDGE; EFFECT SIZES; OVERCONFIDENCE; COHERENCE; UNCERTAINTY; STRATEGY; ABILITY; WISDOM; ERRORS;

D O I：

暂无

中图分类号：

B84 [心理学];

学科分类号：

04 ; 0402 ;

摘要：

Three experiments (N = 550) examined the effect of an interval construction elicitation method used in several expert elicitation studies on judgment accuracy. Participants made judgments about topics that were either searchable or unsearchable online using one of two order variations of the interval construction procedure. One group of participants provided their best judgment (one step) prior to constructing an interval (i.e., lower bound, upper bound, and a confidence rating that the correct value fell in the range provided), whereas another group of participants provided their best judgment last, after the three-step confidence interval was constructed. The overall effect of this elicitation method was not significant in 8 out of 9 univariate tests. Moreover, the calibration of confidence intervals was not affected by elicitation order. The findings warrant skepticism regarding the benefit of prior confidence interval construction for improving judgment accuracy.

引用

页码：783 / 797

页数：15

共 50 条

[31] Confidence judgment in a temporal generalization task: Accuracy and sensitivity to task difficulty
Lamotte, Mathilde
Droit-Volet, Sylvie
Izaute, Marie
[J]. ANNEE PSYCHOLOGIQUE, 2017, 117 (03): : 275 - 298
[32] Estimating Accuracy and Confidence Interval of an Intelligent Diagnostic Reasoner System
Das, Sreerupa
Harris, Michelle
[J]. 2009 IEEE AUTOTESTCON, 2009, : 284 - 287
[33] Alternative Confidence Interval Methods Used in the Diagnostic Accuracy Studies
Erdogan, Semra
Gulhan, Orekici Temel
[J]. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2016, 2016
[34] The effect of stress on accuracy and speed of judgment
Farhadbeigi, Parvaneh
Bagherian, Fatemeh
Banaraki, Anahita Khorrami
[J]. 4TH INTERNATIONAL CONFERENCE OF COGNITIVE SCIENCE, 2012, 32 : 49 - 52
[35] EFFECT OF SEX IN ACCURACY OF PREDICTIVE JUDGMENT
KNESTRICK, JL
[J]. PERCEPTUAL AND MOTOR SKILLS, 1975, 41 (02) : 355 - 360
[36] EFFECT OF INTERVAL BETWEEN SIGNALS ON TEMPORAL JUDGMENT
FAROQI, MA
PARAMESW.EG
[J]. CANADIAN JOURNAL OF PSYCHOLOGY, 1966, 20 (01): : 12 - 12
[37] A METHOD OF CONFIDENCE-INTERVAL CONSTRUCTION FOR SIMULATION OUTPUT ANALYSIS
CHOOBINEH, F
BALLARD, JL
[J]. OPERATIONS RESEARCH LETTERS, 1989, 8 (05) : 265 - 270
[38] A Simple Correlation Adjustment Procedure Applied to Confidence Interval Construction
Andersson, Per Gosta
[J]. AMERICAN STATISTICIAN, 2009, 63 (03): : 258 - 262
[39] Including systematic uncertainties in confidence interval construction for Poisson statistics
Conrad, J
Botner, O
Hallgren, A
de los Heros, CP
[J]. PHYSICAL REVIEW D, 2003, 67 (01)
[40] Quantitative coronary angiography: Impact of imaging parameters on accuracy and confidence interval
Seissl, H
Peukert, K
Geiger, B
Verstraelen, BJA
[J]. HEART AND VESSELS, 1997, : 212 - 216

← 1 2 3 4 5 →