Bridging the Gap Between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-centered AI Systems

被引:183
|
作者
Ben Shneiderman [1 ]
机构
[1] Univ Maryland, Dept Comp Sci, College Pk, MD 20742 USA
关键词
Human-centered AI; Human-Computer Interaction; Artificial Intelligence; reliable; safe; trustworthy; software engineering practices; management strategies; independent oversight; design; ARTIFICIAL-INTELLIGENCE; MATURITY MODEL; DATA ANALYTICS; TRANSPARENCY;
D O I
10.1145/3419764
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article attempts to bridge the gap between widely discussed ethical principles of Human-centered AI (HCAI) and practical steps for effective governance. Since HCAI systems are developed and implemented in multiple organizational structures, I propose 15 recommendations at three levels of governance: team, organization, and industry. The recommendations are intended to increase the reliability, safety, and trustworthiness of HCAI systems: (1) reliable systems based on sound software engineering practices, (2) safety culture through business management strategies, and (3) trustworthy certification by independent oversight. Software engineering practices within teams include audit trails to enable analysis of failures, software engineering workflows, verification and validation testing, bias testing to enhance fairness, and explainable user interfaces:the safety culture within organizations comes from management strategies that include leadership commitment to safety, hiring and training oriented to safety, extensive reporting of failures and near misses, internal review boards for problems and future plans, and alignment with industry standard practices. The trustworthiness certification comes from industry-wide efforts that include government interventions and regulation, accounting firms conducting external audits, insurance companies compensating for failures, non-governmental and civil society organizations advancing design principles, and professional organizations and research institutes developing standards, policies, and novel ideas. The larger goal of effective governance is to limit the dangers and increase the benefits of HCAI to individuals, organizations. and society.
引用
收藏
页数:31
相关论文
共 50 条
  • [22] AN INTEGRATIVE AND TRANSDISCIPLINARY APPROACH FOR A HUMAN-CENTERED DESIGN OF AI-BASED WORK SYSTEMS
    Schlicht, Larissa
    Melzer, Marlen
    Roesler, Ulrike
    Voss, Stefan
    Vock, Silvia
    [J]. PROCEEDINGS OF ASME 2021 INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION (IMECE2021), VOL 13, 2021,
  • [23] Explainable medical imaging AI needs human-centered design: guidelines and evidence from a systematic review
    Haomin Chen
    Catalina Gomez
    Chien-Ming Huang
    Mathias Unberath
    [J]. npj Digital Medicine, 5
  • [24] Explainable medical imaging AI needs human-centered design: guidelines and evidence from a systematic review
    Chen, Haomin
    Gomez, Catalina
    Huang, Chien-Ming
    Unberath, Mathias
    [J]. NPJ DIGITAL MEDICINE, 2022, 5 (01)
  • [25] Closing the gap between guidelines and practice: Ensuring safe and healthy beginnings
    Lannon, C
    Stark, AR
    [J]. PEDIATRICS, 2004, 114 (02) : 494 - U17
  • [26] Systems Theory: Bridging the Gap Between Science and Practice for Systems Engineering
    Keating, Charles B.
    Katina, Polinpapilinho F.
    Hodge, Richard
    Bradley, Joseph M.
    [J]. INCOSE International Symposium, 2020, 30 (01): : 1017 - 1031
  • [27] Design and Evaluation of High-Quality Symbiotic AI Systems through a Human-Centered Approach
    Calvano, Miriana
    [J]. PROCEEDINGS OF 2024 28TH INTERNATION CONFERENCE ON EVALUATION AND ASSESSMENT IN SOFTWARE ENGINEERING, EASE 2024, 2024, : 488 - 493
  • [28] Community science: Bridging the gap between science and practice with community-centered models
    Wandersman, A
    [J]. AMERICAN JOURNAL OF COMMUNITY PSYCHOLOGY, 2003, 31 (3-4) : 227 - 242
  • [29] Bridging the gap between education and practice in the design and development of engineering systems
    Lewis, K
    [J]. FRONTIERS IN EDUCATION 1997 - 27TH ANNUAL CONFERENCE, PROCEEDINGS, BOLS I - III, 1997, : 1465 - 1468
  • [30] Human-centered design and evaluation of AI-empowered clinical decision support systems: a systematic review
    Wang, Liuping
    Zhang, Zhan
    Wang, Dakuo
    Cao, Weidan
    Zhou, Xiaomu
    Zhang, Ping
    Liu, Jianxing
    Fan, Xiangmin
    Tian, Feng
    [J]. FRONTIERS IN COMPUTER SCIENCE, 2023, 5