Do as AI say: susceptibility in deployment of clinical decision-aids

被引：3

作者：

Gaube, Susanne ^{[1
,2
]}

Suresh, Harini ^{[3
]}

Raue, Martina ^{[2
]}

Merritt, Alexander ^{[4
]}

Berkowitz, Seth J. ^{[5
]}

Lermer, Eva ^{[6
,7
]}

Coughlin, Joseph F. ^{[2
]}

Guttag, John V. ^{[3
]}

Colak, Errol ^{[8
,9
]}

Ghassemi, Marzyeh ^{[10
,11
,12
]}

机构：

[1] Univ Regensburg, Dept Psychol, Regensburg, Germany

[2] MIT, MIT AgeLab, 77 Massachusetts Ave, Cambridge, MA 02139 USA

[3] MIT, MIT Comp Sci & Artificial Intelligence Lab, 77 Massachusetts Ave, Cambridge, MA 02139 USA

[4] Boston Med Ctr, Boston, MA USA

[5] Beth Israel Deaconess Med Ctr, Dept Radiol, 330 Brookline Ave, Boston, MA 02215 USA

[6] Ludwig Maximilians Univ Munchen, LMU Ctr Leadership & People Management, Munich, Germany

[7] FOM Univ Appl Sci Econ & Management, Munich, Germany

[8] St Michaels Hosp, Li Ka Shing Knowledge Inst, Toronto, ON, Canada

[9] Univ Toronto, Dept Med Imaging, Toronto, ON, Canada

[10] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada

[11] Univ Toronto, Dept Med, Toronto, ON, Canada

[12] Vector Inst, Toronto, ON, Canada

来源：

NPJ DIGITAL MEDICINE | 2021年 / 4卷 / 01期

基金：

加拿大自然科学与工程研究理事会;

关键词：

CLASSIFICATION; ALGORITHM; INTELLIGENCE; PERFORMANCE; TRUST;

D O I：

10.1038/s41746-021-00385-9

中图分类号：

R19 [保健组织与事业（卫生事业管理）];

学科分类号：

摘要：

Artificial intelligence (AI) models for decision support have been developed for clinical settings such as radiology, but little work evaluates the potential impact of such systems. In this study, physicians received chest X-rays and diagnostic advice, some of which was inaccurate, and were asked to evaluate advice quality and make diagnoses. All advice was generated by human experts, but some was labeled as coming from an AI system. As a group, radiologists rated advice as lower quality when it appeared to come from an AI system; physicians with less task-expertise did not. Diagnostic accuracy was significantly worse when participants received inaccurate advice, regardless of the purported source. This work raises important considerations for how advice, AI and non-AI, should be deployed in clinical environments.

引用

页数：8

共 50 条

[1] Do as AI say: susceptibility in deployment of clinical decision-aids
Susanne Gaube
Harini Suresh
Martina Raue
Alexander Merritt
Seth J. Berkowitz
Eva Lermer
Joseph F. Coughlin
John V. Guttag
Errol Colak
Marzyeh Ghassemi
[J]. npj Digital Medicine, 4
[2] Decision-aids for prostate cancer screening
Volk, RJ
Spann, SJ
[J]. JOURNAL OF FAMILY PRACTICE, 2000, 49 (05): : 425 - 427
[3] Formal decision-aids in surgery: results of a survey
Aust, B
Ganslandt, T
Sitter, H
Prokosch, U
Zielke, A
Ohmann, C
[J]. CHIRURG, 1999, 70 (07): : 823 - 829
[4] Decision-aids for non-expert decision makers An experimental investigation of performance and learning
Beck, Grant
Farkas, Maia
Wheeler, Patrick
Arunachalam, Vairam
[J]. JOURNAL OF ACCOUNTING AND ORGANIZATIONAL CHANGE, 2020, 16 (02): : 169 - 188
[5] Do decision aids improve clinical practice?
Jordan, Vanessa
[J]. JOURNAL OF PRIMARY HEALTH CARE, 2024, 16 (01) : 110 - 111
[6] Decision Making in Social Work with Families and Children: Developing Decision-Aids Compatible with Cognition
De Bortoli, Lillian
Dolan, Mairead
[J]. BRITISH JOURNAL OF SOCIAL WORK, 2015, 45 (07): : 2142 - 2160
[7] Assessment of operator trust in and utilization of automated decision-aids under different framing conditions
Bisantz, AM
Seong, Y
[J]. INTERNATIONAL JOURNAL OF INDUSTRIAL ERGONOMICS, 2001, 28 (02) : 85 - 97
[8] Simulated Automated Facial Recognition Systems as Decision-Aids in Forensic Face Matching Tasks
Carragher, Daniel J.
Hancock, Peter J. B.
[J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2023, 152 (05) : 1286 - 1304
[9] WHAT DO YOU SAY TO A CHILD WITH AIDS
LIPSON, M
[J]. HASTINGS CENTER REPORT, 1993, 23 (02) : 6 - 12
[10] Clinical deployment of AI for prostate cancer diagnosis
Janowczyk, Andrew
Leo, Patrick
Rubin, Mark A.
[J]. LANCET DIGITAL HEALTH, 2020, 2 (08): : E383 - E384

← 1 2 3 4 5 →