A systematic review of trustworthy and explainable artificial intelligence in healthcare: Assessment of quality, bias risk, and data fusion

被引:185
|
作者
Albahri, A. S. [1 ]
Duhaim, Ali M. [2 ]
Fadhel, Mohammed A. [3 ]
Alnoor, Alhamzah [4 ]
Baqer, Noor S. [5 ]
Alzubaidi, Laith [6 ,7 ]
Albahri, O. S. [8 ,9 ]
Alamoodi, A. H. [10 ]
Bai, Jinshuai [6 ,7 ]
Salhi, Asma
Santamaria, Jose
Ouyang, Chun
Gupta, Ashish [6 ,7 ]
Gu, Yuantong [6 ,7 ]
Deveci, Muhammet
机构
[1] Iraqi Commiss Comp & Informat ICCI, Baghdad, Iraq
[2] Minist Educ, Nasiriyah, Iraq
[3] Univ Sumer, Coll Comp Sci & Informat Technol, Rifai, Iraq
[4] Southern Tech Univ, Basrah, Iraq
[5] Minist Educ, Baghdad, Iraq
[6] Queensland Univ Technol, Sch Mech Med & Proc Engn, Brisbane, Qld 4000, Australia
[7] Queensland Univ Technol, ARC Ind Transformat Training Ctr Joint Biomech, Brisbane, Qld 4000, Australia
[8] Mazaya Univ Coll, Comp Tech Engn Dept, Nasiriyah, Iraq
[9] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic, Australia
[10] Univ Pendidikan Sultan Idris UPSI, Fac Comp & Meta Technol FKMT, Tanjung Malim, Perak, Malaysia
基金
澳大利亚研究理事会;
关键词
Trustworthiness; Explainability; Artificial intelligence; Healthcare; Information fusion; MONITORING-SYSTEM; BLOCKCHAIN; FRAMEWORK; AI; PREDICTION; DIAGNOSIS; NETWORKS; MEDICINE; MODELS;
D O I
10.1016/j.inffus.2023.03.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the last few years, the trend in health care of embracing artificial intelligence (AI) has dramatically changed the medical landscape. Medical centres have adopted AI applications to increase the accuracy of disease diag-nosis and mitigate health risks. AI applications have changed rules and policies related to healthcare practice and work ethics. However, building trustworthy and explainable AI (XAI) in healthcare systems is still in its early stages. Specifically, the European Union has stated that AI must be human-centred and trustworthy, whereas in the healthcare sector, low methodological quality and high bias risk have become major concerns. This study endeavours to offer a systematic review of the trustworthiness and explainability of AI applications in healthcare, incorporating the assessment of quality, bias risk, and data fusion to supplement previous studies and provide more accurate and definitive findings. Likewise, 64 recent contributions on the trustworthiness of AI in healthcare from multiple databases (i.e., ScienceDirect, Scopus, Web of Science, and IEEE Xplore) were identified using a rigorous literature search method and selection criteria. The considered papers were categorised into a coherent and systematic classification including seven categories: explainable robotics, prediction, decision support, blockchain, transparency, digital health, and review. In this paper, we have presented a systematic and comprehensive analysis of earlier studies and opened the door to potential future studies by discussing in depth the challenges, motivations, and recommendations. In this study a systematic science mapping analysis in order to reorganise and summarise the results of earlier studies to address the issues of trustworthiness and objectivity was also performed. Moreover, this work has provided decisive evidence for the trustworthiness of AI in health care by presenting eight current state-of-the-art critical analyses regarding those more relevant research gaps. In addition, to the best of our knowledge, this study is the first to investigate the feasibility of utilising trustworthy and XAI applications in healthcare, by incorporating data fusion techniques and connecting various important pieces of information from available healthcare datasets and AI algorithms. The analysis of the revised contri-butions revealed crucial implications for academics and practitioners, and then potential methodological aspects to enhance the trustworthiness of AI applications in the medical sector were reviewed. Successively, the theo-retical concept and current use of 17 XAI methods in health care were addressed. Finally, several objectives and guidelines were provided to policymakers to establish electronic health-care systems focused on achieving relevant features such as legitimacy, morality, and robustness. Several types of information fusion in healthcare were focused on in this study, including data, feature, image, decision, multimodal, hybrid, and temporal.
引用
收藏
页码:156 / 191
页数:36
相关论文
共 50 条
  • [41] Data and model bias in artificial intelligence for healthcare applications in New Zealand
    Yogarajan, Vithya
    Dobbie, Gillian
    Leitch, Sharon
    Keegan, Te Taka
    Bensemann, Joshua
    Witbrock, Michael
    Asrani, Varsha
    Reith, David
    FRONTIERS IN COMPUTER SCIENCE, 2022, 4
  • [42] Artificial intelligence bias in medical system designs: a systematic review
    Ashish Kumar
    Vivekanand Aelgani
    Rubeena Vohra
    Suneet K. Gupta
    Mrinalini Bhagawati
    Sudip Paul
    Luca Saba
    Neha Suri
    Narendra N. Khanna
    John R. Laird
    Amer M. Johri
    Manudeep Kalra
    Mostafa M. Fouda
    Mostafa Fatemi
    Subbaram Naidu
    Jasjit S. Suri
    Multimedia Tools and Applications, 2024, 83 : 18005 - 18057
  • [43] Artificial intelligence bias in medical system designs: a systematic review
    Kumar, Ashish
    Aelgani, Vivekanand
    Vohra, Rubeena
    Gupta, Suneet K.
    Bhagawati, Mrinalini
    Paul, Sudip
    Saba, Luca
    Suri, Neha
    Khanna, Narendra N.
    Laird, John R.
    Johri, Amer M.
    Kalra, Manudeep
    Fouda, Mostafa M.
    Fatemi, Mostafa
    Naidu, Subbaram
    Suri, Jasjit S.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) : 18005 - 18057
  • [44] A comprehensive evaluation of explainable Artificial Intelligence techniques in stroke diagnosis: A systematic review
    Gurmessa, Daraje Kaba
    Jimma, Worku
    COGENT ENGINEERING, 2023, 10 (02):
  • [45] Explainable Artificial Intelligence (XAI): A Systematic Literature Review on Taxonomies and Applications in Finance
    Martins, Tiago
    de Almeida, Ana Maria
    Cardoso, Elsa
    Nunes, Luis
    IEEE ACCESS, 2024, 12 : 618 - 629
  • [46] Deciphering Knee Osteoarthritis Diagnostic Features With Explainable Artificial Intelligence: A Systematic Review
    Teoh, Yun Xin
    Othmani, Alice
    Li Goh, Siew
    Usman, Juliana
    Lai, Khin Wee
    IEEE ACCESS, 2024, 12 : 109080 - 109108
  • [47] Systematic Review of the Application of Artificial Intelligence in Healthcare and Nursing Care
    Koo, Thai Hau
    Zakaria, Andee Dzulkarnaen
    Ng, Jet Kwan
    Leong, Xue Bin
    MALAYSIAN JOURNAL OF MEDICAL SCIENCES, 2024, 31 (05): : 135 - 142
  • [48] Opening the Black Box: A systematic review on explainable artificial intelligence in remote sensing
    Hoehl, Adrian
    Obadic, Ivica
    Fernandez-Torres, Miguel-Angel
    Najjar, Hiba
    Oliveira, Dario Augusto Borges
    Akata, Zeynep
    Dengel, Andreas
    Zhu, Xiao Xiang
    IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2024, 12 (04) : 261 - 304
  • [49] Exploring the Landscape of Explainable Artificial Intelligence (XAI): A Systematic Review of Techniques and Applications
    Hamida, Sayda Umma
    Chowdhury, Mohammad Jabed Morshed
    Chakraborty, Narayan Ranjan
    Biswas, Kamanashis
    Sami, Shahrab Khan
    BIG DATA AND COGNITIVE COMPUTING, 2024, 8 (11)
  • [50] Recent Advances of Artificial Intelligence in Healthcare: A Systematic Literature Review
    Kitsios, Fotis
    Kamariotou, Maria
    Syngelakis, Aristomenis I.
    Talias, Michael A.
    APPLIED SCIENCES-BASEL, 2023, 13 (13):