The importance of interpretability and visualization in machine learning for applications in medicine and health care

被引:275
|
作者
Vellido, Alfredo [1 ]
机构
[1] Univ Politecn Cataluna, Intelligent Data Sci & Artificial Intelligence ID, Dept Comp Sci, Barcelona, Spain
来源
NEURAL COMPUTING & APPLICATIONS | 2020年 / 32卷 / 24期
关键词
Interpretability; Explainability; Machine learning; Visualization; Medicine; Health care; UNINTENDED CONSEQUENCES; DEEP; MULTICENTER;
D O I
10.1007/s00521-019-04051-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In a short period of time, many areas of science have made a sharp transition towards data-dependent methods. In some cases, this process has been enabled by simultaneous advances in data acquisition and the development of networked system technologies. This new situation is particularly clear in the life sciences, where data overabundance has sparked a flurry of new methodologies for data management and analysis. This can be seen as a perfect scenario for the use of machine learning and computational intelligence techniques to address problems in which more traditional data analysis approaches might struggle. But, this scenario also poses some serious challenges. One of them is model interpretability and explainability, especially for complex nonlinear models. In some areas such as medicine and health care, not addressing such challenge might seriously limit the chances of adoption, in real practice, of computer-based systems that rely on machine learning and computational intelligence methods for data analysis. In this paper, we reflect on recent investigations about the interpretability and explainability of machine learning methods and discuss their impact on medicine and health care. We pay specific attention to one of the ways in which interpretability and explainability in this context can be addressed, which is through data and model visualization. We argue that, beyond improving model interpretability as a goal in itself, we need to integrate the medical experts in the design of data analysis interpretation strategies. Otherwise, machine learning is unlikely to become a part of routine clinical and health care practice.
引用
收藏
页码:18069 / 18083
页数:15
相关论文
共 50 条
  • [31] Machine learning interpretability meets TLS fingerprinting
    Mahdi Jafari Siavoshani
    Amirhossein Khajehpour
    Amirmohammad Ziaei Bideh
    Amirali Gatmiri
    Ali Taheri
    [J]. Soft Computing, 2023, 27 : 7191 - 7208
  • [32] Evaluating Attribution Methods in Machine Learning Interpretability
    Ratul, Qudrat E. Alahy
    Serra, Edoardo
    Cuzzocrea, Alfredo
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, : 5239 - 5245
  • [33] A Framework for Interpretability in Machine Learning for Medical Imaging
    Wang, Alan Q.
    Karaman, Batuhan K.
    Kim, Heejong
    Rosenthal, Jacob
    Saluja, Rachit
    Young, Sean I.
    Sabuncu, Mert R.
    [J]. IEEE ACCESS, 2024, 12 : 53277 - 53292
  • [34] Machine Learning Interpretability: A Survey on Methods and Metrics
    Carvalho, Diogo, V
    Pereira, Eduardo M.
    Cardoso, Jaime S.
    [J]. ELECTRONICS, 2019, 8 (08)
  • [35] Machine learning interpretability meets TLS fingerprinting
    Siavoshani, Mahdi Jafari
    Khajehpour, Amirhossein
    Bideh, Amirmohammad Ziaei
    Gatmiri, Amirali
    Taheri, Ali
    [J]. SOFT COMPUTING, 2023, 27 (11) : 7191 - 7208
  • [36] StrategyAtlas: Strategy Analysis for Machine Learning Interpretability
    Collaris, Dennis
    van Wijk, Jarke J.
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (06) : 2996 - 3008
  • [37] Trustworthy Machine Learning: Robustness, Generalization, and Interpretability
    Wang, Jindong
    Li, Haoliang
    Wang, Haohan
    Pan, Sinno Jialin
    Xie, Xing
    [J]. PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 5827 - 5828
  • [38] Machine learning and real time data visualization for formulation applications
    Partopour, Behnam
    Boggara, Mohan
    Ren, Cindy
    Rathore, Nitin
    [J]. ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2019, 257
  • [39] Explaining Explanations: An Overview of Interpretability of Machine Learning
    Gilpin, Leilani H.
    Bau, David
    Yuan, Ben Z.
    Bajwa, Ayesha
    Specter, Michael
    Kagal, Lalana
    [J]. 2018 IEEE 5TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2018, : 80 - 89
  • [40] Interpreting Interpretability: Understanding Data Scientists' Use of Interpretability Tools for Machine Learning
    Kaur, Harmanpreet
    Nori, Harsha
    Jenkins, Samuel
    Caruana, Rich
    Wallach, Hanna
    Vaughan, Jennifer Wortman
    [J]. PROCEEDINGS OF THE 2020 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI'20), 2020,