Trustworthy AI in the public sector: An empirical analysis of a Swedish labor market decision-support system

被引:12
|
作者
Berman, Alexander [1 ]
Licht, Karl de Fine [2 ]
Carlsson, Vanja [3 ]
机构
[1] Univ Gothenburg, Ctr Linguist Theory & Studies Probabil CLASP, Dept Philosophy Linguist & Theory Sci, Box 200, S-40530 Gothenburg, Sweden
[2] Chalmers Univ Technol, Div Sci Technol & Soc, Gothenburg, Sweden
[3] Univ Gothenburg, Sch Publ Adm, Gothenburg, Sweden
关键词
Decision -support systems; Trustworthy AI; Artificial Intelligence; Public employment services; Public sector;
D O I
10.1016/j.techsoc.2024.102471
中图分类号
D58 [社会生活与社会问题]; C913 [社会生活与社会问题];
学科分类号
摘要
This paper investigates the deployment of Artificial Intelligence (AI) in the Swedish Public Employment Service (PES), focusing on the concept of trustworthy AI in public decision -making. Despite Sweden's advanced digitalization efforts and the widespread application of AI in the public sector, our study reveals significant gaps between theoretical ambitions and practical outcomes, particularly in the context of AI's trustworthiness. We employ a robust theoretical framework comprising Institutional Theory, the Resource -Based View (RBV), and Ambidexterity Theory, to analyze the challenges and discrepancies in AI implementation within PES. Our analysis shows that while AI promises enhanced decision -making efficiency, the reality is marred by issues of transparency, interpretability, and stakeholder engagement. The opacity of the neural network used by the agency to assess jobseekers' need for support and the lack of comprehensive technical understanding among PES management contribute to the challenges in achieving transparent and interpretable AI systems. Economic pressures for efficiency often overshadow the need for ethical considerations and stakeholder involvement, leading to decisions that may not be in the best interest of jobseekers. We propose recommendations for enhancing AI's trustworthiness in public services, emphasizing the importance of stakeholder engagement, particularly involving jobseekers in the decision -making process. Our study advocates for a more nuanced balance between the use of advanced AI technologies and the leveraging of internal resources such as skilled personnel and organizational knowledge. We also highlight the need for improved AI literacy among both management and personnel to effectively navigate AI's integration into public decision -making processes. Our findings contribute to the ongoing debate on trustworthy AI, offering a detailed case study that bridges the gap between theoretical exploration and practical application. By scrutinizing the AI implementation in the Swedish PES, we provide valuable insights and guidelines for other public sector organizations grappling with the integration of AI into their decision -making processes.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] An empirical analysis on ERP improving user's Decision-Support benefits: Evidences from key users
    Songsheng Chen
    Lingbing Liu
    PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON RISK AND RELIABILITY MANAGEMENT, VOLS I AND II, 2008, : 858 - 865
  • [32] A decision support system for tecnical analysis by indicators on stock market
    Çetinyokuş, Tahsin
    Gökçen, Hadi
    Journal of the Faculty of Engineering and Architecture of Gazi University, 2002, 17 (01): : 43 - 58
  • [33] Impact of an Electronic Decision-Support System on Nursing Triage Process: A Usability and Workflow Analysis
    Agnihotri, Tanya
    Fan, Mark
    McLeod, Shelley
    Borgundvaag, Bjug
    Ovens, Howard
    McCarron, Joy
    Trbovich, Patricia
    CANADIAN JOURNAL OF NURSING RESEARCH, 2021, 53 (02) : 107 - 113
  • [34] PASIM - A SPREADSHEET-BASED DECISION-SUPPORT SYSTEM FOR PERFORMANCE ANALYSIS OF PRODUCTION WORKERS
    NTUEN, CA
    WINCHESTER, WW
    CHESTNUT, J
    PARK, EH
    COMPUTERS & INDUSTRIAL ENGINEERING, 1994, 27 (1-4) : 193 - 196
  • [35] Web-based Decision Support System for the Public Sector Comprising Linguistic Variables
    Bencina, Joze
    INFORMATICA-JOURNAL OF COMPUTING AND INFORMATICS, 2007, 31 (03): : 311 - 323
  • [36] Hybrid decision support based on knowledge discovery and AI techniques for the management of maintenance services in the public transport sector
    Adamson, Ken
    Campbell, Piers
    Orsoni, Alessandra
    2005 IEEE INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS, 2005, : 674 - 678
  • [37] DREAM - A SHELL-LIKE SOFTWARE SYSTEM FOR MEDICAL DATA-ANALYSIS AND DECISION-SUPPORT
    KUNCHEVA, L
    ANDREEVA, K
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 1993, 40 (02) : 73 - 81
  • [38] A case-acquisition and decision-support system for the analysis of group-average lactation curves
    Pietersma, D
    Lacroix, R
    Lefebvre, D
    Block, E
    Wade, KM
    JOURNAL OF DAIRY SCIENCE, 2001, 84 (03) : 730 - 739
  • [39] Success and hindrance factors in the development of decision support systems in banking sector in India: an empirical analysis
    Goyal, D. P.
    Bhatia, Ambika
    Goyal, O. P.
    INTERNATIONAL JOURNAL OF INDIAN CULTURE AND BUSINESS MANAGEMENT, 2010, 3 (03) : 349 - 361
  • [40] An integrated custom decision-support computer aided facility management informative system for healthcare facilities and analysis
    Iadanza, Ernesto
    Luschi, Alessio
    HEALTH AND TECHNOLOGY, 2020, 10 (01) : 135 - 145