Automation bias and verification complexity: a systematic review

被引:123
|
作者
Lyell, David [1 ]
Coiera, Enrico [1 ]
机构
[1] Macquarie Univ, Australian Inst Hlth Innovat, Ctr Hlth Informat, Sydney, NSW 2109, Australia
关键词
decision support systems; clinical cognitive biases; complexity; CLINICAL DECISION-SUPPORT; HUMAN-PERFORMANCE CONSEQUENCES; TASK COMPLEXITY; RELIABILITY; AIDS; COMPLACENCY; IMPACT; MANAGEMENT; DIFFICULTY; CAD;
D O I
10.1093/jamia/ocw105
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Introduction: While potentially reducing decision errors, decision support systems can introduce new types of errors. Automation bias (AB) happens when users become overreliant on decision support, which reduces vigilance in information seeking and processing. Most research originates from the human factors literature, where the prevailing view is that AB occurs only in multitasking environments. Objectives: This review seeks to compare the human factors and health care literature, focusing on the apparent association of AB with multitasking and task complexity. Data sources: EMBASE, Medline, Compendex, Inspec, IEEE Xplore, Scopus, Web of Science, PsycINFO, and Business Source Premiere from 1983 to 2015. Study selection: Evaluation studies where task execution was assisted by automation and resulted in errors were included. Participants needed to be able to verify automation correctness and perform the task manually. Methods: Tasks were identified and grouped. Task and automation type and presence of multitasking were noted. Each task was rated for its verification complexity. Results: Of 890 papers identified, 40 met the inclusion criteria; 6 were in health care. Contrary to the prevailing human factors view, AB was found in single tasks, typically involving diagnosis rather than monitoring, and with high verification complexity. Limitations: The literature is fragmented, with large discrepancies in how AB is reported. Few studies reported the statistical significance of AB compared to a control condition. Conclusion: AB appears to be associated with the degree of cognitive load experienced in decision tasks, and appears to not be uniquely associated with multitasking. Strategies to minimize AB might focus on cognitive load reduction.
引用
收藏
页码:423 / 431
页数:9
相关论文
共 50 条
  • [1] Automation bias, accountability, and verification behaviors
    Mosier, KL
    Skitka, JL
    Heers, ST
    [J]. PROCEEDINGS OF THE HUMAN FACTORS AND ERGONOMICS SOCIETY - 40TH ANNUAL MEETING, VOLS 1 AND 2: HUMAN CENTERED TECHNOLOGY - KEY TO THE FUTURE, 1996, : 204 - 208
  • [2] Automation bias: a systematic review of frequency, effect mediators, and mitigators
    Goddard, Kate
    Roudsari, Abdul
    Wyatt, Jeremy C.
    [J]. JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2012, 19 (01) : 121 - 127
  • [3] Decision Support and Automation Bias: Methodology and Preliminary Results of a Systematic Review
    Goddard, Kate
    Roudsari, Abdul
    Wyatt, Jeremy
    [J]. INTERNATIONAL PERSPECTIVES IN HEALTH INFORMATICS, 2011, 164 : 3 - 7
  • [4] EFFECT OF VERIFICATION BIAS ON SCREENING FOR CELIAC DISEASE: A SYSTEMATIC REVIEW AND META-ANALYSIS
    Hujoel, Isabel A.
    Jansson-Knodell, Claire L.
    Hujoel, Philippe P.
    Choung, Rok Seon
    Rubio-Tapia, Alberto
    Murray, Joseph A.
    [J]. GASTROENTEROLOGY, 2018, 154 (06) : S781 - S781
  • [5] Systematic review automation technologies
    Guy Tsafnat
    Paul Glasziou
    Miew Keen Choong
    Adam Dunn
    Filippo Galgani
    Enrico Coiera
    [J]. Systematic Reviews, 3 (1)
  • [6] Systematic review automation technologies
    Tsafnat, Guy
    Glasziou, Paul
    Choong, Miew Keen
    Dunn, Adam
    Galgani, Filippo
    Coiera, Enrico
    [J]. SYSTEMATIC REVIEWS, 2014, 3
  • [7] The Effect of Cognitive Load and Task Complexity on Automation Bias in Electronic Prescribing
    Lyell, David
    Magrabi, Farah
    Coiera, Enrico
    [J]. HUMAN FACTORS, 2018, 60 (07) : 1008 - 1021
  • [8] Automation of systematic literature reviews: A systematic literature review
    van Dinter, Raymon
    Tekinerdogan, Bedir
    Catal, Cagatay
    [J]. INFORMATION AND SOFTWARE TECHNOLOGY, 2021, 136
  • [9] Automation use and automation bias
    Mosier, KL
    Skitka, LJ
    [J]. PROCEEDINGS OF THE HUMAN FACTORS AND ERGONOMICS SOCIETY 43RD ANNUAL MEETING, VOLS 1 AND 2, 1999, : 344 - 348
  • [10] Review of publication bias in studies on publication bias - Systematic review is needed
    Forbes, RB
    McCarron, M
    [J]. BRITISH MEDICAL JOURNAL, 2005, 331 (7517): : 638 - 638