Explainable AI for Cyber-Physical Systems: Issues and Challenges

被引:4
|
作者
Hoenig, Amber [1 ]
Roy, Kaushik [2 ]
Acquaah, Yaa Takyiwaa [2 ]
Yi, Sun [3 ]
Desai, Salil S. [4 ,5 ]
机构
[1] North Carolina Agr & Tech State Univ, Dept Computat Data Sci & Engn, Greensboro, NC 27411 USA
[2] North Carolina Agr & Tech State Univ, Dept Comp Sci, Greensboro, NC 27411 USA
[3] North Carolina Agr & Tech State Univ, Dept Mech Engn, Greensboro, NC 27411 USA
[4] North Carolina Agr & Tech State Univ, Dept Ind & Syst Engn, Greensboro, NC 27411 USA
[5] North Carolina Agr & Tech State Univ, Ctr Excellence Prod Design & Adv Mfg, Greensboro, NC 27411 USA
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Artificial intelligence; Cyber-physical systems; Explainable AI; Biological system modeling; Reviews; Safety; Computer security; Fifth Industrial Revolution; Cyber-physical systems (CPS); cyber-resilience; cybersecurity; explainable artificial intelligence (XAI); industrial CPS; Industry; 5.0; ARTIFICIAL-INTELLIGENCE; INTRUSION DETECTION; FUTURE;
D O I
10.1109/ACCESS.2024.3395444
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence and cyber-physical systems (CPS) are two of the key technologies of the future that are enabling major global shifts. However, most of the current implementations of AI in CPS are not explainable, which creates serious problems in ethical, legal, regulatory, and other domains. Therefore, it is necessary for explainable artificial intelligence (XAI) to be integrated with cyber-physical systems to meet the vital needs for control, fairness, accountability, safety, cyber-resilience, and cybersecurity. The goal of this review is to demonstrate the need, benefits, challenges, and implementation of XAI for CPS. We review the existing literature about XAI and CPS, discuss the current state of the art, examine applications in different domains, and make recommendations for future research directions. To the best of our knowledge, this is the first peer-reviewed academic article to provide a comprehensive review of general XAI for CPS. We also contribute new research ideas including development of multisensory explanations and outputs for these systems, application of XAI to CPS to decrease occupational burnout and increase employee engagement, and enumeration of the multidisciplinary goals and benefits of XAI as applied to cyber-physical systems.
引用
收藏
页码:73113 / 73140
页数:28
相关论文
共 50 条
  • [41] Theory, Applications, and Challenges of Cyber-Physical Systems 2021
    Su, Hang
    Xiao, Bo
    Zhou, Mingchuan
    Qi, Wen
    Sandoval, Juan
    Kim, Seong Tae
    COMPLEXITY, 2022, 2022
  • [42] Cyber-Physical Systems - New Challenges for Science and Technology
    Dumitrache, Ioan
    CONTROL ENGINEERING AND APPLIED INFORMATICS, 2011, 13 (03): : 3 - 4
  • [43] A Survey on Concepts, Applications, and Challenges in Cyber-Physical Systems
    Gunes, Volkan
    Peter, Steffen
    Givargis, Tony
    Vahid, Frank
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2014, 8 (12): : 4242 - 4268
  • [44] Continuous Experimentation on Cyber-Physical Systems: Challenges and Opportunities
    Giaimo, Federico
    Yin, Hang
    Berger, Christian
    Crnkovic, Ivica
    PROCEEDINGS OF THE XP2016 SCIENTIFIC WORKSHOPS, 2016,
  • [45] Theory, Applications, and Challenges of Cyber-Physical Systems 2021
    Su, Hang
    Xiao, Bo
    Zhou, Mingchuan
    Qi, Wen
    Sandoval, Juan
    Kim, Seong Tae
    COMPLEXITY, 2022, 2022
  • [46] Middleware for Pervasive and Cyber-Physical Systems: Opportunities and Challenges
    Singh, Gurdip
    2015 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATION WORKSHOPS (PERCOM WORKSHOPS), 2015, : 50 - 50
  • [47] Medical Cyber-Physical Systems: IoMT Applications and Challenges
    Watson, Amanda
    Park, Jean
    Pugh, Sydney
    Sokolsky, Oleg
    Weimer, James
    Lee, Insup
    2022 56TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2022, : 998 - 1004
  • [48] Challenges and Research Directions in Medical Cyber-Physical Systems
    Lee, Insup
    Sokolsky, Oleg
    Chen, Sanjian
    Hatcliff, John
    Jee, Eunkyoung
    Kim, BaekGyu
    King, Andrew
    Mullen-Fortino, Margaret
    Park, Soojin
    Roederer, Alexander
    Venkatasubramanian, Krishna K.
    PROCEEDINGS OF THE IEEE, 2012, 100 (01) : 75 - 90
  • [49] Cyber-Physical Systems for Water Sustainability: Challenges and Opportunities
    Wang, Zhaohui
    Song, Houbing
    Watkins, David W.
    Ong, Keat Ghee
    Xue, Pengfei
    Yang, Qing
    Shi, Xianming
    IEEE COMMUNICATIONS MAGAZINE, 2015, 53 (05) : 216 - 222
  • [50] Intrusion Detection in Cyber-Physical Systems: Techniques and Challenges
    Han, Song
    Xie, Miao
    Chen, Hsiao-Hwa
    Ling, Yun
    IEEE SYSTEMS JOURNAL, 2014, 8 (04): : 1049 - 1059