Trustworthy AI in the public sector: An empirical analysis of a Swedish labor market decision-support system

被引:12
|
作者
Berman, Alexander [1 ]
Licht, Karl de Fine [2 ]
Carlsson, Vanja [3 ]
机构
[1] Univ Gothenburg, Ctr Linguist Theory & Studies Probabil CLASP, Dept Philosophy Linguist & Theory Sci, Box 200, S-40530 Gothenburg, Sweden
[2] Chalmers Univ Technol, Div Sci Technol & Soc, Gothenburg, Sweden
[3] Univ Gothenburg, Sch Publ Adm, Gothenburg, Sweden
关键词
Decision -support systems; Trustworthy AI; Artificial Intelligence; Public employment services; Public sector;
D O I
10.1016/j.techsoc.2024.102471
中图分类号
D58 [社会生活与社会问题]; C913 [社会生活与社会问题];
学科分类号
摘要
This paper investigates the deployment of Artificial Intelligence (AI) in the Swedish Public Employment Service (PES), focusing on the concept of trustworthy AI in public decision -making. Despite Sweden's advanced digitalization efforts and the widespread application of AI in the public sector, our study reveals significant gaps between theoretical ambitions and practical outcomes, particularly in the context of AI's trustworthiness. We employ a robust theoretical framework comprising Institutional Theory, the Resource -Based View (RBV), and Ambidexterity Theory, to analyze the challenges and discrepancies in AI implementation within PES. Our analysis shows that while AI promises enhanced decision -making efficiency, the reality is marred by issues of transparency, interpretability, and stakeholder engagement. The opacity of the neural network used by the agency to assess jobseekers' need for support and the lack of comprehensive technical understanding among PES management contribute to the challenges in achieving transparent and interpretable AI systems. Economic pressures for efficiency often overshadow the need for ethical considerations and stakeholder involvement, leading to decisions that may not be in the best interest of jobseekers. We propose recommendations for enhancing AI's trustworthiness in public services, emphasizing the importance of stakeholder engagement, particularly involving jobseekers in the decision -making process. Our study advocates for a more nuanced balance between the use of advanced AI technologies and the leveraging of internal resources such as skilled personnel and organizational knowledge. We also highlight the need for improved AI literacy among both management and personnel to effectively navigate AI's integration into public decision -making processes. Our findings contribute to the ongoing debate on trustworthy AI, offering a detailed case study that bridges the gap between theoretical exploration and practical application. By scrutinizing the AI implementation in the Swedish PES, we provide valuable insights and guidelines for other public sector organizations grappling with the integration of AI into their decision -making processes.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] AN APPROACH TO DEVELOPMENT OF DECISION-SUPPORT SYSTEMS FOR A PUBLIC-SECTOR ADMINISTRATION
    BINYUSOFF, M
    JENKINS, J
    JOURNAL OF INFORMATION TECHNOLOGY, 1994, 9 (01) : 29 - 37
  • [2] Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
    Dlugatch, Rachel
    Georgieva, Antoniya
    Kerasidou, Angeliki
    BMC MEDICAL ETHICS, 2023, 24 (01)
  • [3] Trustworthy artificial intelligence and ethical design: public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care
    Rachel Dlugatch
    Antoniya Georgieva
    Angeliki Kerasidou
    BMC Medical Ethics, 24
  • [4] INTERACTIVE DECISION-SUPPORT SYSTEM FOR ORGANIZATIONAL ANALYSIS
    SUSHIL
    RAGHUNATHAN, B
    DECISION SUPPORT SYSTEMS, 1994, 11 (03) : 283 - 298
  • [5] CONSTRUCTION DECISION-SUPPORT SYSTEM FOR DELAY ANALYSIS
    YATES, JK
    JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT-ASCE, 1993, 119 (02): : 226 - 244
  • [6] A DECISION-SUPPORT SYSTEM FOR ACQUISITIONS BUDGETING IN PUBLIC-LIBRARIES
    GLEESON, ME
    OTTENSMANN, JR
    INTERFACES, 1994, 24 (05) : 107 - 117
  • [7] Remote decision-support system for value-analysis
    Alcantara, P
    de la Garza, JM
    Rodriguez, W
    DECISION SCIENCES INSTITUTE 1998 PROCEEDINGS, VOLS 1-3, 1998, : 693 - 695
  • [8] Requirements for trustworthy AI-enabled automated decision-making in the public sector: A systematic review
    Agbabiaka, Olusegun
    Ojo, Adegboyega
    Connolly, Niall
    TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2025, 215
  • [10] OK-FIRST: A decision-support system for public safety agencies
    Crawford, KC
    Morris, DA
    McPherson, RA
    Johnson, HL
    Shafer, MA
    Wolfinbarger, JM
    Hughes, TW
    14TH INTERNATIONAL CONFERENCE ON INTERACTIVE INFORMATION AND PROCESSING SYSTEM (IIPS) FOR METEOROLOGY, OCEANOGRAPHY, AND HYDROLOGY, 1998, : 5 - 9