The Moral Choice Machine

被引:16
|
作者
Schramowski, Patrick [1 ]
Turan, Cigdem [1 ]
Jentzsch, Sophie [1 ,2 ]
Rothkopf, Constantin [3 ,4 ]
Kersting, Kristian [1 ,4 ]
机构
[1] Tech Univ Darmstadt, Dept Comp Sci, Darmstadt, Germany
[2] German Aerosp Ctr DLR, Inst Software Technol, Cologne, Germany
[3] Tech Univ Darmstadt, Inst Psychol, Darmstadt, Germany
[4] Tech Univ Darmstadt, Ctr Cognit Sci, Darmstadt, Germany
来源
关键词
moral bias; fairness in machine learning; text-embedding models; natural language processing; AI; machine learning; CULTURAL-DIFFERENCES; IMPLICIT; ORIENTATION; ATTITUDES; SYSTEMS;
D O I
10.3389/frai.2020.00036
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Allowing machines to choose whether to kill humans would be devastating for world peace and security. But how do we equip machines with the ability to learn ethical or even moral choices? In this study, we show that applying machine learning to human texts can extract deontological ethical reasoning about "right" and "wrong" conduct. We create a template list of prompts and responses, such as "Should I [action]?", "Is it okay to [action]?", etc. with corresponding answers of "Yes/no, I should (not)." and "Yes/no, it is (not)." The model's bias score is the difference between the model's score of the positive response ("Yes, I should") and that of the negative response ("No, I should not"). For a given choice, the model's overall bias score is the mean of the bias scores of all question/answer templates paired with that choice. Specifically, the resulting model, called the Moral Choice Machine (MCM), calculates the bias score on a sentence level using embeddings of the Universal Sentence Encoder since the moral value of an action to be taken depends on its context. It is objectionable to kill living beings, but it is fine to kill time. It is essential to eat, yet one might not eat dirt. It is important to spread information, yet one should not spread misinformation. Our results indicate that text corpora contain recoverable and accurate imprints of our social, ethical and moral choices, even with context information. Actually, training the Moral Choice Machine on different temporal news and book corpora from the year 1510 to 2008/2009 demonstrate the evolution of moral and ethical choices over different time periods for both atomic actions and actions with context information. By training it on different cultural sources such as the Bible and the constitution of different countries, the dynamics of moral choices in culture, including technology are revealed. That is the fact that moral biases can be extracted, quantified, tracked, and compared across cultures and over time.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] MORAL AUTHORITY AND MORAL CHOICE
    WALSH, WH
    PROCEEDINGS OF THE ARISTOTELIAN SOCIETY, 1965, 65 (01): : 1 - 23
  • [2] The moral choice
    Harris, J
    NEW SCIENTIST, 2006, 190 (2556) : 24 - 24
  • [3] The Moral Machine: Is It Moral?
    Nascimento, A. M.
    Vismari, L. F.
    Queiroz, A. C. M.
    Cugnasca, P. S.
    Camargo Jr, J. B.
    de Almeida Jr, J. R.
    COMPUTER SAFETY, RELIABILITY, AND SECURITY, SAFECOMP 2019, 2019, 11699 : 405 - 410
  • [4] PERSONAL MORAL PHILOSOPHIES AND MORAL CHOICE
    FORSYTH, DR
    NYE, JL
    JOURNAL OF RESEARCH IN PERSONALITY, 1990, 24 (04) : 398 - 414
  • [5] MORAL CHOICE AND EDUCATION
    PEKARSKY, D
    JOURNAL OF MORAL EDUCATION, 1983, 12 (01) : 3 - 13
  • [6] THE FREEDOM OF MORAL CHOICE
    BORZYKH, VV
    VOPROSY FILOSOFII, 1992, (01) : 175 - 177
  • [7] Security and Moral Choice
    McSweeney, Bill
    RELACIONES INTERNACIONALES-MADRID, 2009, (11): : 119 - 138
  • [8] Gratitude is a moral choice
    Largen, Kristin Johnston
    DIALOG-A JOURNAL OF THEOLOGY, 2018, 57 (04): : 234 - 234
  • [9] TATESMANSHIP AND MORAL CHOICE
    Wolfers, Arnold
    WORLD POLITICS, 1949, 1 : 175 - 195
  • [10] Moral public choice
    Kolm, SC
    PUBLIC CHOICE, 1996, 87 (1-2) : 117 - 141