A strategy to improve expert technology forecasts

被引:12
|
作者
Savage, Tamara [1 ]
Davis, Alex [1 ]
Fischhoff, Baruch [1 ]
Morgan, M. Granger [1 ]
机构
[1] Carnegie Mellon Univ, Dept Engn & Publ Policy, Pittsburgh, PA 15213 USA
基金
美国安德鲁·梅隆基金会;
关键词
expert elicitation; overconfidence; debiasing; technology forecasting; DECISION-MAKING; OVERCONFIDENCE; ASSESSMENTS; ACCURACY; COSTS; US;
D O I
10.1073/pnas.2021558118
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Forecasts of the future cost and performance of technologies are often used to support decision-making. However, retrospective reviews find that many forecasts made by experts are not very accurate and are often seriously overconfident, with realized values too frequently falling outside of forecasted ranges. Here, we outline a hybrid approach to expert elicitation that we believe might improve forecasts of future technologies. The proposed approach iteratively combines the judgments of technical domain experts with those of experts who are knowledgeable about broader issues of technology adoption and public policy. We motivate the approach with results from a pilot study designed to help forecasters think systematically about factors beyond the technology itself that may shape its future, such as policy, economic, and social factors. Forecasters who received briefings on these topics provided wider forecast intervals than those receiving no assistance. Forecasts of the future cost and performance of technologies are used in planning a sustainable energy future, as well as to support decision-making in many other public and private contexts (1-6). These forecasts are intended to help decision-makers anticipate future events, avoid surprises, and allocate resources effectively. To that end, technology forecasts should be both as accurate as possible and properly qualified, so that decision-makers know how heavily to
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Can Groups Improve Expert Economic and Financial Forecasts?
    Smith, Warwick
    Hanea, Anca M.
    Burgman, Mark A.
    [J]. FORECASTING, 2022, 4 (03): : 699 - 716
  • [2] Leveraging expert systems technology to improve service industry
    Metaxiotis, K.
    [J]. EUROPEAN BUSINESS REVIEW, 2005, 17 (03) : 232 - +
  • [3] COMBINING FORECASTS WITH EXPERT INFORMATION
    GOLOVCHENKO, VB
    NOSKOV, SI
    [J]. AUTOMATION AND REMOTE CONTROL, 1992, 53 (11) : 1746 - 1753
  • [4] Technology strategy to improve university academic performance
    Urbina Najera, Argelia Berenice
    [J]. PIXEL-BIT- REVISTA DE MEDIOS Y EDUCACION, 2019, (56): : 71 - 93
  • [5] Averaging Model Forecasts and Expert Forecasts: Why Does It Work?
    Franses, Philip Hans
    [J]. INTERFACES, 2011, 41 (02) : 177 - 181
  • [6] Using expert system technology for new venture strategy planning
    Dologite, DG
    Mockler, RJ
    Gartenfeld, ME
    [J]. CHALLENGES OF INFORMATION TECHNOLOGY MANAGEMENT IN THE 21ST CENTURY, 2000, : 29 - 33
  • [7] Comparing expert elicitation and model-based probabilistic technology cost forecasts for the energy transition
    Meng, Jing
    Way, Rupert
    Verdolini, Elena
    Anadon, Laura Diaz
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2021, 118 (27)
  • [8] Combining expert-adjusted forecasts
    van Dijk, Dick
    Franses, Philip Hans
    [J]. JOURNAL OF FORECASTING, 2019, 38 (05) : 415 - 421
  • [9] Engineers' forecasts for technology
    不详
    [J]. FUTURIST, 2003, 37 (04) : 8 - 9
  • [10] CAN KNOWLEDGE IMPROVE FORECASTS
    KEYFITZ, N
    [J]. POPULATION AND DEVELOPMENT REVIEW, 1982, 8 (04) : 729 - 751