Using Machine Learning in Psychiatry: The Need to Establish a Framework That Nurtures Trustworthiness

被引:41
|
作者
Chandler, Chelsea [1 ]
Foltz, Peter W. [2 ,3 ]
Elvevag, Brita [4 ,5 ]
机构
[1] Univ Colorado Boulder, Dept Comp Sci, 430 UCB,1111 Engn Dr, Boulder, CO 80309 USA
[2] Univ Colorado Boulder, Inst Cognit Sci, Boulder, CO USA
[3] Pearson PLC, London, England
[4] Univ Tromso, Dept Clin Med, Tromso, Norway
[5] Norwegian Ctr eHlth Res, Tromso, Norway
关键词
computational psychiatry; artificial intelligence; guidelines; explainability; transparency; generalizability;
D O I
10.1093/schbul/sbz105
中图分类号
R749 [精神病学];
学科分类号
100205 ;
摘要
The rapid embracing of artificial intelligence in psychiatry has a flavor of being the current "wild west"; a multidisciplinary approach that is very technical and complex, yet seems to produce findings that resonate. These studies are hard to review as the methods are often opaque and it is tricky to find the suitable combination of reviewers. This issue will only get more complex in the absence of a rigorous framework to evaluate such studies and thus nurture trustworthiness. Therefore, our paper discusses the urgency of the field to develop a framework with which to evaluate the complex methodology such that the process is done honestly, fairly, scientifically, and accurately. However, evaluation is a complicated process and so we focus on three issues, namely explainability, transparency, and generalizability, that are critical for establishing the viability of using artificial intelligence in psychiatry. We discuss how defining these three issues helps towards building a framework to ensure trustworthiness, but show how difficult definition can be, as the terms have different meanings in medicine, computer science, and law. We conclude that it is important to start the discussion such that there can be a call for policy on this and that the community takes extra care when reviewing clinical applications of such models.
引用
收藏
页码:11 / 14
页数:4
相关论文
共 50 条
  • [1] Trustworthiness of Spam Email Addresses using Machine Learning
    Janez-Martino, Francisco
    Alaiz-Rodriguez, Rocio
    Gonzalez-Castro, Victor
    Fidalgo, Eduardo
    PROCEEDINGS OF THE 21ST ACM SYMPOSIUM ON DOCUMENT ENGINEERING (DOCENG '21), 2021,
  • [2] Fostering Trustworthiness in Machine Learning Algorithms
    Huai, Mengdi
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 20, 2024, : 22670 - 22670
  • [3] Machine learning in bail decisions and judges' trustworthiness
    Morin-Martel, Alexis
    AI & SOCIETY, 2024, 39 (04) : 2033 - 2044
  • [4] On the Application of Supervised Machine Learning to Trustworthiness Assessment
    Hauke, Sascha
    Biedermann, Sebastian
    Muehlhaeuser, Max
    Heider, Dominik
    2013 12TH IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2013), 2013, : 525 - 534
  • [5] The Promise of Machine Learning for Psychiatry
    Rutherford, Saige
    BIOLOGICAL PSYCHIATRY, 2020, 88 (11) : E53 - E55
  • [6] A Framework for Analyzing Ransomware using Machine Learning
    Poudyal, Subash
    Subedi, Kul Prasad
    Dasgupta, Dipankar
    2018 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI), 2018, : 1692 - 1699
  • [7] A framework for extrusion detection using machine learning
    Luo, Yan
    Tsai, Jeffrey J. P.
    ISORC 2008: 11TH IEEE SYMPOSIUM ON OBJECT/COMPONENT/SERVICE-ORIENTED REAL-TIME DISTRIBUTED COMPUTING - PROCEEDINGS, 2008, : 83 - 88
  • [8] Making Individual Prognoses in Psychiatry Using Neuroimaging and Machine Learning
    Janssen, Ronald J.
    Mourao-Miranda, Janaina
    Schnack, Hugo G.
    BIOLOGICAL PSYCHIATRY-COGNITIVE NEUROSCIENCE AND NEUROIMAGING, 2018, 3 (09) : 798 - 808
  • [9] RITUAL: a Platform Quantifying the Trustworthiness of Supervised Machine Learning
    Celdran, Alberto Huertas
    Bauer, Jan
    Demirci, Melike
    Leupp, Joel
    Franco, Muriel Figueredo
    Sanchez Sanchez, Pedro M.
    Bovet, Gerome
    Martinez Perez, Gregorio
    Stiller, Burkhard
    2022 18TH INTERNATIONAL CONFERENCE ON NETWORK AND SERVICE MANAGEMENT (CNSM 2022): INTELLIGENT MANAGEMENT OF DISRUPTIVE NETWORK TECHNOLOGIES AND SERVICES, 2022,
  • [10] Tracking historical changes in trustworthiness using machine learning analyses of facial cues in paintings
    Safra, Lou
    Chevallier, Coralie
    Grezes, Julie
    Baumard, Nicolas
    NATURE COMMUNICATIONS, 2020, 11 (01)