Machine learning's limitations in avoiding automation of bias

被引:8
|
作者
Varona, Daniel [1 ]
Lizama-Mue, Yadira [1 ]
Suarez, Juan Luis [1 ]
机构
[1] Western Univ, CulturePlex Lab, 1151 Richmond St, London, ON N6A 3K7, Canada
关键词
Machine learning; Bias; Bias automation; Artificial intelligence; PREDICTION;
D O I
10.1007/s00146-020-00996-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The use of predictive systems has become wider with the development of related computational methods, and the evolution of the sciences in which these methods are applied Solon and Selbst (Calif L REV 104: 671-732, 2016) and Pedreschi et al. (2007). The referred methods include machine learning techniques, face and/or voice recognition, temperature mapping, and other, within the artificial intelligence domain. These techniques are being applied to solve problems in socially and politically sensitive areas such as crime prevention and justice management, crowd management, and emotion analysis, just to mention a few. However, dissimilar predictions can be found nowadays as the result of the application of these methods resulting in misclassification, for example for the case of conviction risk assessment Office of Probation and Pretrial Services (2011) or decision-making process when designing public policies Lange (2015). The goal of this paper is to identify current gaps on fairness achievement within the context of predictive systems in artificial intelligence by analyzing available academic and scientific literature up to 2020. To achieve this goal, we have gathered available materials at the Web of Science and Scopus from last 5 years and analyzed the different proposed methods and their results in relation to the bias as an emergent issue in the Artificial Intelligence field of study. Our tentative conclusions indicate that machine learning has some intrinsic limitations which are leading to automate the bias when designing predictive algorithms. Consequently, other methods should be explored; or we should redefine the way current machine learning approaches are being used when building decision making/decision support systems for crucial institutions of our political systems such as the judicial system, just to mention one.
引用
收藏
页码:197 / 203
页数:7
相关论文
共 50 条
  • [1] Machine learning’s limitations in avoiding automation of bias
    Daniel Varona
    Yadira Lizama-Mue
    Juan Luis Suárez
    [J]. AI & SOCIETY, 2021, 36 : 197 - 203
  • [2] Limitations of mitigating judicial bias with machine learning
    Kristian Lum
    [J]. Nature Human Behaviour, 1 (7)
  • [3] Bias and ethical considerations in machine learning and the automation of perioperative risk assessment
    O'Reilly-Shah, Vikas N.
    Gentry, Katherine R.
    Walters, Andrew M.
    Zivot, Joel
    Anderson, Corrie T.
    Tighe, Patrick J.
    [J]. BRITISH JOURNAL OF ANAESTHESIA, 2020, 125 (06) : 843 - 846
  • [4] Machine learning automation
    Xu, Zongben
    Zhou, Zhi-Hua
    Zhu, Wenwu
    [J]. NATIONAL SCIENCE REVIEW, 2024, 11 (08)
  • [5] Machine learning automation
    Zongben Xu
    ZhiHua Zhou
    Wenwu Zhu
    [J]. National Science Review., 2024, 11 (08) - 8
  • [6] Machine Learning in Automation
    Beyerer, Juergen
    Niggemann, Oliver
    [J]. AT-AUTOMATISIERUNGSTECHNIK, 2018, 66 (04) : 281 - 282
  • [7] Limitations of mitigating judicial bias with machine learning Machine-learning algorithms trained with data that encode human bias will reproduce, not eliminate, the bias, says Kristian Lum.
    Lum, Kristian
    [J]. NATURE HUMAN BEHAVIOUR, 2017, 1 (07):
  • [8] Avoiding the Inherent Limitations in Datasets Used for Measuring Aesthetics When Using a Machine Learning Approach
    Carballal, Adrian
    Fernandez-Lozano, Carlos
    Rodriguez-Fernandez, Nereida
    Castro, Luz
    Santos, Antonino
    [J]. COMPLEXITY, 2019,
  • [9] Learning without prejudice: Avoiding bias in recognition
    Rupprecht, Christian
    Kapil, Ansh
    Liu, Nan
    Ballan, Lamberto
    Tombari, Federico
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 173 : 24 - 32
  • [10] Scotland's referendum - avoiding bias
    Wober, J. Mallory
    [J]. PSYCHOLOGIST, 2012, 25 (12) : 867 - 867