Effect of confidence interval construction on judgment accuracy

被引：0

作者：

Mandel, David R. ^{[1
]}

Collins, Robert N. ^{[1
]}

Risko, Evan F. ^{[2
]}

Fugelsang, Jonathan A. ^{[2
]}

机构：

[1] Def Res & Dev Canada, Intelligence Influence & Collaborat Sect, Ottawa, ON, Canada

[2] HumanSystems Inc, Guelph, ON, Canada

来源：

JUDGMENT AND DECISION MAKING | 2020年 / 15卷 / 05期

关键词：

judgment; accuracy; confidence intervals; order effect; EXPERT KNOWLEDGE; EFFECT SIZES; OVERCONFIDENCE; COHERENCE; UNCERTAINTY; STRATEGY; ABILITY; WISDOM; ERRORS;

D O I：

暂无

中图分类号：

B84 [心理学];

学科分类号：

04 ; 0402 ;

摘要：

Three experiments (N = 550) examined the effect of an interval construction elicitation method used in several expert elicitation studies on judgment accuracy. Participants made judgments about topics that were either searchable or unsearchable online using one of two order variations of the interval construction procedure. One group of participants provided their best judgment (one step) prior to constructing an interval (i.e., lower bound, upper bound, and a confidence rating that the correct value fell in the range provided), whereas another group of participants provided their best judgment last, after the three-step confidence interval was constructed. The overall effect of this elicitation method was not significant in 8 out of 9 univariate tests. Moreover, the calibration of confidence intervals was not affected by elicitation order. The findings warrant skepticism regarding the benefit of prior confidence interval construction for improving judgment accuracy.

引用

页码：783 / 797

页数：15

共 50 条

[1] ACCURACY AND CONFIDENCE IN GROUP JUDGMENT
SNIEZEK, JA
HENRY, RA
[J]. ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1989, 43 (01) : 1 - 28
[2] Confidence in performance judgment accuracy: the unskilled and unaware effect revisited
Marion Händel
Markus Dresel
[J]. Metacognition and Learning, 2018, 13 : 265 - 285
[3] Confidence in performance judgment accuracy: the unskilled and unaware effect revisited
Haendel, Marion
Dresel, Markus
[J]. METACOGNITION AND LEARNING, 2018, 13 (03) : 265 - 285
[4] The effect of judgment type and confidence scale on confidence-accuracy calibration in face recognition
Weber, N
Brewer, N
[J]. JOURNAL OF APPLIED PSYCHOLOGY, 2003, 88 (03) : 490 - 499
[5] Confidence and accuracy in trait inference: Judgment by similarity
Koehler, DJ
Brenner, LA
Liberman, V
Tversky, A
[J]. ACTA PSYCHOLOGICA, 1996, 92 (01) : 33 - 57
[6] Communication of confidence as a determinant of group judgment accuracy
Bloomfield, R
Libby, R
Nelson, MW
[J]. ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 1996, 68 (03) : 287 - 300
[7] Effects of amount of information on judgment accuracy and confidence
Tsai, Claire I.
Klayman, Joshua
Hastie, Reid
[J]. ORGANIZATIONAL BEHAVIOR AND HUMAN DECISION PROCESSES, 2008, 107 (02) : 97 - 105
[8] The accuracy of a new confidence interval method
Strelen, JC
[J]. PROCEEDINGS OF THE 2004 WINTER SIMULATION CONFERENCE, VOLS 1 AND 2, 2004, : 654 - 662
[9] The Effect of Retention Interval on the Eyewitness Identification Confidence-Accuracy Relationship
Wixted, John T.
Read, J. Don
Lindsay, D. Stephen
[J]. JOURNAL OF APPLIED RESEARCH IN MEMORY AND COGNITION, 2016, 5 (02) : 192 - 203
[10] The Effect of Retention Interval on the Confidence-Accuracy Relationship for Eyewitness Identification
Sauer, James
Brewer, Neil
Zweck, Tick
Weber, Nathan
[J]. LAW AND HUMAN BEHAVIOR, 2010, 34 (04) : 337 - 347

← 1 2 3 4 5 →