Social Integration of Artificial Intelligence: Functions, Automation Allocation Logic and Human-Autonomy Trust

被引:64
|
作者
Abbass, Hussein A. [1 ]
机构
[1] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2600, Australia
基金
澳大利亚研究理事会;
关键词
Adaptive aiding; Adaptive automation; Artificial intelligence; Augmented cognition; Automation logic; Cognitive cyber symbiosis; Function allocation; Human-AI teaming; Human-autonomy teaming; Trust;
D O I
10.1007/s12559-018-9619-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial intelligence (AI) is finding more uses in the human society resulting in a need to scrutinise the relationship between humans and AI. Technology itself has advanced from the mere encoding of human knowledge into a machine to designing machines that "know how" to autonomously acquire the knowledge they need, learn from it and act independently in the environment. Fortunately, this need is not new; it has scientific grounds that could be traced back to the inception of computers. This paper uses a multi-disciplinary lens to explore how the natural cognitive intelligence in a human could interface with the artificial cognitive intelligence of a machine. The scientific journey over the last 50 years will be examined to understand the Human-AI relationship, and to present the nature of, and the role of trust in, this relationship. Risks and opportunities sitting at the human-AI interface will be studied to reveal some of the fundamental technical challenges for a trustworthy human-AI relationship. The critical assessment of the literature leads to the conclusion that any social integration of AI into the human social system would necessitate a form of a relationship on one level or another in society, meaning that humans will "always" actively participate in certain decision-making loopseither in-the-loop or on-the-loopthat will influence the operations of AI, regardless of how sophisticated it is.
引用
收藏
页码:159 / 171
页数:13
相关论文
共 50 条
  • [1] Social Integration of Artificial Intelligence: Functions, Automation Allocation Logic and Human-Autonomy Trust
    Hussein A. Abbass
    [J]. Cognitive Computation, 2019, 11 : 159 - 171
  • [2] Trusting machine intelligence: artificial intelligence and human-autonomy teaming in military operations
    Mayer, Michael
    [J]. DEFENCE AND SECURITY ANALYSIS, 2023, 39 (04): : 521 - 538
  • [3] Artificial intelligence and human autonomy: the case of driving automation
    Fossa, Fabio
    [J]. AI & SOCIETY, 2024,
  • [4] Trust and Team Performance in Human-Autonomy Teaming
    McNeese, Nathan J.
    Demir, Mustafa
    Chiou, Erin K.
    Cooke, Nancy J.
    [J]. INTERNATIONAL JOURNAL OF ELECTRONIC COMMERCE, 2021, 25 (01) : 51 - 72
  • [5] Understanding the Role of Trust in Human-Autonomy Teaming
    McNeese, Nathan J.
    Demir, Mustafa
    Chiou, Erin
    Cooke, Nancy
    Yanikian, Giovanni
    [J]. PROCEEDINGS OF THE 52ND ANNUAL HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES, 2019, : 254 - 263
  • [6] IMPACTS: a trust model for human-autonomy teaming
    Ming Hou
    Geoffrey Ho
    David Dunwoody
    [J]. Human-Intelligent Systems Integration, 2021, 3 (2) : 79 - 97
  • [7] Confidence Metrics Improve Human-Autonomy Integration
    Marathe, Amar R.
    Lance, Brent J.
    McDowell, Kaleb
    Nothwang, William D.
    Metcalfe, Jason S.
    [J]. HRI'14: PROCEEDINGS OF THE 2014 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2014, : 240 - 241
  • [8] The Dynamics of Trust and Verbal Anthropomorphism in Human-Autonomy Teaming
    Cohen, Myke C.
    Demir, Mustafa
    Chiou, Erin K.
    Cooke, Nancy J.
    [J]. PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON HUMAN-MACHINE SYSTEMS (ICHMS), 2021, : 168 - 173
  • [9] Human-Autonomy Teaming for Critical Command and Control Functions
    Irandoust, Hengameh
    Benaskeur, Abder
    [J]. PROCEEDINGS OF THE 2020 IEEE INTERNATIONAL CONFERENCE ON HUMAN-MACHINE SYSTEMS (ICHMS), 2020, : 512 - 517
  • [10] Exploration of Teammate Trust and Interaction Dynamics in Human-Autonomy Teaming
    Demir, Mustafa
    McNeese, Nathan J.
    Gorman, Jaime C.
    Cooke, Nancy J.
    Myers, Christopher W.
    Grimm, David A.
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2021, 51 (06) : 696 - 705