The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations

被引:115
|
作者
Chatzimparmpas, A. [1 ]
Martins, R. M. [1 ]
Jusufi, I. [1 ]
Kucher, K. [1 ]
Rossi, F. [2 ]
Kerren, A. [1 ]
机构
[1] Linnaeus Univ, Dept Comp Sci & Media Technol, Vaxjo, Sweden
[2] PSL Univ, Univ Paris Dauphine, Ceremade, Paris, France
关键词
trustworthy machine learning; visualization; interpretable machine learning; explainable machine learning; HIGH-DIMENSIONAL DATA; INTERACTIVE VISUAL EXPLORATION; AQUEOUS SOLUBILITY; REGRESSION-MODELS; CLUSTER-ANALYSIS; SAMPLE-SIZE; REDUCTION; QUALITY; ANALYTICS; SYSTEM;
D O I
10.1111/cgf.14034
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Machine learning (ML) models are nowadays used in complex applications in various domains, such as medicine, bioinformatics, and other sciences. Due to their black box nature, however, it may sometimes be hard to understand and trust the results they provide. This has increased the demand for reliable visualization tools related to enhancing trust in ML models, which has become a prominent topic of research in the visualization community over the past decades. To provide an overview and present the frontiers of current research on the topic, we present a State-of-the-Art Report (STAR) on enhancing trust in ML models with the use of interactive visualization. We define and describe the background of the topic, introduce a categorization for visualization techniques that aim to accomplish this goal, and discuss insights and opportunities for future research directions. Among our contributions is a categorization of trust against different facets of interactive ML, expanded and improved from previous research. Our results are investigated from different analytical perspectives: (a) providing a statistical overview, (b) summarizing key findings, (c) performing topic analyses, and (d) exploring the data sets used in the individual papers, all with the support of an interactive web-based survey browser. We intend this survey to be beneficial for visualization researchers whose interests involve making ML models more trustworthy, as well as researchers and practitioners from other disciplines in their search for effective visualization techniques suitable for solving their tasks with confidence and conveying meaning to their data.
引用
收藏
页码:713 / 756
页数:44
相关论文
共 50 条
  • [31] Trust Me, I'm Lying: Enhancing Machine-to-Machine Trust
    Hickert, Cameron
    Tekeoglu, Ali
    Watson, Ryan
    Maurio, Joseph
    Syed, Daniel
    Chavis, Jeffrey
    Brown, Gill
    Sookoor, Tamim
    2022 13TH ACM/IEEE INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SYSTEMS (ICCPS 2022), 2022, : 286 - 287
  • [32] USE OF MODELS AT CRBRP ADVANCES THE STATE OF THE ART
    BREWSTER, J
    KOVAR, EO
    DECOURSEY, D
    POWER ENGINEERING, 1983, 87 (04) : 72 - 76
  • [33] Prediction of candidemia with machine learning techniques: state of the art
    Giacobbe, Daniele Roberto
    Marelli, Cristina
    Mora, Sara
    Cappello, Alice
    Signori, Alessio
    Vena, Antonio
    Guastavino, Sabrina
    Rosso, Nicola
    Campi, Cristina
    Giacomini, Mauro
    Bassetti, Matteo
    FUTURE MICROBIOLOGY, 2024, 19 (10) : 931 - 940
  • [34] Machine learning for science: State of the art and future prospects
    Mjolsness, E
    DeCoste, D
    SCIENCE, 2001, 293 (5537) : 2051 - +
  • [35] State of the Art: Machine Learning Applications in Glioma Imaging
    Lotan, Eyal
    Lotan, Eyal
    Jain, Rajan
    Razavian, Narges
    Fatterpekar, Girish M.
    Lui, Yvonne W.
    AMERICAN JOURNAL OF ROENTGENOLOGY, 2019, 212 (01) : 26 - 37
  • [36] Reinforcement learning applied to machine vision: state of the art
    A. M. Hafiz
    S. A. Parah
    R. A. Bhat
    International Journal of Multimedia Information Retrieval, 2021, 10 : 71 - 82
  • [37] Reinforcement learning applied to machine vision: state of the art
    Hafiz, A. M.
    Parah, S. A.
    Bhat, R. A.
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2021, 10 (02) : 71 - 82
  • [38] Human-in-the-loop machine learning: a state of the art
    Mosqueira-Rey, Eduardo
    Hernandez-Pereira, Elena
    Alonso-Rios, David
    Bobes-Bascaran, Jose
    Fernandez-Leal, Angel
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (04) : 3005 - 3054
  • [39] The State of the Art in Integrating Machine Learning into Visual Analytics
    Endert, A.
    Ribarsky, W.
    Turkay, C.
    Wong, B. L. William
    Nabney, I.
    Diaz Blanco, I.
    Rossi, F.
    COMPUTER GRAPHICS FORUM, 2017, 36 (08) : 458 - 486
  • [40] Machine-Learning Forensics: State of the Art in the Use of Machine-Learning Techniques for Digital Forensic Investigations within Smart Environments
    Tageldin, Laila
    Venter, Hein
    APPLIED SCIENCES-BASEL, 2023, 13 (18):