Bridging the Gap Between Ethics and Practice: Guidelines for Reliable, Safe, and Trustworthy Human-centered AI Systems

被引:183
|
作者
Ben Shneiderman [1 ]
机构
[1] Univ Maryland, Dept Comp Sci, College Pk, MD 20742 USA
关键词
Human-centered AI; Human-Computer Interaction; Artificial Intelligence; reliable; safe; trustworthy; software engineering practices; management strategies; independent oversight; design; ARTIFICIAL-INTELLIGENCE; MATURITY MODEL; DATA ANALYTICS; TRANSPARENCY;
D O I
10.1145/3419764
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article attempts to bridge the gap between widely discussed ethical principles of Human-centered AI (HCAI) and practical steps for effective governance. Since HCAI systems are developed and implemented in multiple organizational structures, I propose 15 recommendations at three levels of governance: team, organization, and industry. The recommendations are intended to increase the reliability, safety, and trustworthiness of HCAI systems: (1) reliable systems based on sound software engineering practices, (2) safety culture through business management strategies, and (3) trustworthy certification by independent oversight. Software engineering practices within teams include audit trails to enable analysis of failures, software engineering workflows, verification and validation testing, bias testing to enhance fairness, and explainable user interfaces:the safety culture within organizations comes from management strategies that include leadership commitment to safety, hiring and training oriented to safety, extensive reporting of failures and near misses, internal review boards for problems and future plans, and alignment with industry standard practices. The trustworthiness certification comes from industry-wide efforts that include government interventions and regulation, accounting firms conducting external audits, insurance companies compensating for failures, non-governmental and civil society organizations advancing design principles, and professional organizations and research institutes developing standards, policies, and novel ideas. The larger goal of effective governance is to limit the dangers and increase the benefits of HCAI to individuals, organizations. and society.
引用
收藏
页数:31
相关论文
共 50 条
  • [1] Tutorial: Human-Centered AI: Reliable, Safe and Trustworthy
    Ben Shneiderman
    [J]. 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES (IUI '21 COMPANION), 2021, : 7 - 8
  • [2] Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy
    Shneiderman, Ben
    [J]. INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2020, 36 (06) : 495 - 504
  • [3] The Challenges and Opportunities of Human-Centered AI for Trustworthy Robots and Autonomous Systems
    He, Hongmei
    Gray, John
    Cangelosi, Angelo
    Meng, Qinggang
    McGinnity, T. Martin
    Mehnen, Jorn
    [J]. IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2022, 14 (04) : 1398 - 1412
  • [4] Trustworthy AI: Closing the gap between development and integration of AI systems in ophthalmic practice
    Gonzalez-Gonzalo, Cristina
    Thee, Eric F.
    Klaver, Caroline C. W.
    Lee, Aaron Y.
    Schlingemann, Reinier O.
    Tufail, Adnan
    Verbraak, Frank
    Sanchez, Clara, I
    [J]. PROGRESS IN RETINAL AND EYE RESEARCH, 2022, 90
  • [5] Bridging the Gap from AI Ethics Research to Practice
    Baxter, Kathy
    Schlesinger, Yoav
    Aerni, Sarah
    Baker, Lewis
    Dawson, Julie
    Kenthapadi, Krishnaram
    Kloumann, Isabel
    Wallach, Hanna
    [J]. FAT* '20: PROCEEDINGS OF THE 2020 CONFERENCE ON FAIRNESS, ACCOUNTABILITY, AND TRANSPARENCY, 2020, : 682 - 682
  • [6] AI governance and ethics in public procurement: Bridging the gap between theory and practice
    von Behr, Timo
    Abrahamsson, Pekka
    [J]. 2022 IEEE 28TH INTERNATIONAL CONFERENCE ON ENGINEERING, TECHNOLOGY AND INNOVATION (ICE/ITMC) & 31ST INTERNATIONAL ASSOCIATION FOR MANAGEMENT OF TECHNOLOGY, IAMOT JOINT CONFERENCE, 2022,
  • [7] Bridging the gap between ethics and clinical practice
    Hamric, AB
    [J]. NURSING OUTLOOK, 2002, 50 (05) : 176 - 178
  • [8] Operationalising AI ethics: how are companies bridging the gap between practice and principles? An exploratory study
    Javier Camacho Ibáñez
    Mónica Villas Olmeda
    [J]. AI & SOCIETY, 2022, 37 : 1663 - 1687
  • [9] Operationalising AI ethics: how are companies bridging the gap between practice and principles? An exploratory study
    Ibanez, Javier Camacho
    Olmeda, Monica Villas
    [J]. AI & SOCIETY, 2022, 37 (04) : 1663 - 1687
  • [10] Ethics in the classroom: bridging the gap between theory and practice
    Rogers, Laura
    Sizer, Nancy Faust
    [J]. JOURNAL OF MORAL EDUCATION, 2010, 39 (02) : 243 - 248