Trustworthy AI in the public sector: An empirical analysis of a Swedish labor market decision-support system

被引:12
|
作者
Berman, Alexander [1 ]
Licht, Karl de Fine [2 ]
Carlsson, Vanja [3 ]
机构
[1] Univ Gothenburg, Ctr Linguist Theory & Studies Probabil CLASP, Dept Philosophy Linguist & Theory Sci, Box 200, S-40530 Gothenburg, Sweden
[2] Chalmers Univ Technol, Div Sci Technol & Soc, Gothenburg, Sweden
[3] Univ Gothenburg, Sch Publ Adm, Gothenburg, Sweden
关键词
Decision -support systems; Trustworthy AI; Artificial Intelligence; Public employment services; Public sector;
D O I
10.1016/j.techsoc.2024.102471
中图分类号
D58 [社会生活与社会问题]; C913 [社会生活与社会问题];
学科分类号
摘要
This paper investigates the deployment of Artificial Intelligence (AI) in the Swedish Public Employment Service (PES), focusing on the concept of trustworthy AI in public decision -making. Despite Sweden's advanced digitalization efforts and the widespread application of AI in the public sector, our study reveals significant gaps between theoretical ambitions and practical outcomes, particularly in the context of AI's trustworthiness. We employ a robust theoretical framework comprising Institutional Theory, the Resource -Based View (RBV), and Ambidexterity Theory, to analyze the challenges and discrepancies in AI implementation within PES. Our analysis shows that while AI promises enhanced decision -making efficiency, the reality is marred by issues of transparency, interpretability, and stakeholder engagement. The opacity of the neural network used by the agency to assess jobseekers' need for support and the lack of comprehensive technical understanding among PES management contribute to the challenges in achieving transparent and interpretable AI systems. Economic pressures for efficiency often overshadow the need for ethical considerations and stakeholder involvement, leading to decisions that may not be in the best interest of jobseekers. We propose recommendations for enhancing AI's trustworthiness in public services, emphasizing the importance of stakeholder engagement, particularly involving jobseekers in the decision -making process. Our study advocates for a more nuanced balance between the use of advanced AI technologies and the leveraging of internal resources such as skilled personnel and organizational knowledge. We also highlight the need for improved AI literacy among both management and personnel to effectively navigate AI's integration into public decision -making processes. Our findings contribute to the ongoing debate on trustworthy AI, offering a detailed case study that bridges the gap between theoretical exploration and practical application. By scrutinizing the AI implementation in the Swedish PES, we provide valuable insights and guidelines for other public sector organizations grappling with the integration of AI into their decision -making processes.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] A decision-support tool for investment analysis of automated oestrus detection technologies in a seasonal dairy production system
    Thomas, E. B.
    Dolecheck, K. A.
    Mark, T. B.
    Eastwood, C. R.
    Rue, B. T. Dela
    Bewley, J. M.
    ANIMAL PRODUCTION SCIENCE, 2019, 59 (12) : 2280 - 2287
  • [42] An integrated custom decision-support computer aided facility management informative system for healthcare facilities and analysis
    Ernesto Iadanza
    Alessio Luschi
    Health and Technology, 2020, 10 : 135 - 145
  • [43] Post-market analysis of an AI-powered clinical decision support tool for ovarian stimulation
    Fanton, M.
    Chang, Z.
    Suraj, V.
    Miller, B.
    HUMAN REPRODUCTION, 2024, 39
  • [44] Healthcare professionals satisfaction and AI-based clinical decision support system in public sector hospitals during health crises: a cross-sectional study
    Ahmad, Nisar
    Du, Shaofu
    Ahmed, Fawad
    ul Amin, Noor
    Yi, Xu
    INFORMATION TECHNOLOGY & MANAGEMENT, 2023,
  • [45] A Clinical Decision-Support System Based on Three-Stage Integrated Image Analysis for Diagnosing Lung Disease
    Cheng, Ching-Hsue
    Chen, Hsien-Hsiu
    Chen, Tai-Liang
    SYMMETRY-BASEL, 2020, 12 (03):
  • [46] Implementing a clinical decision-support system in practice: A qualitative analysis of influencing attitudes and characteristics among general practitioners
    Toth-Pal, Eva
    Wardh, Inger
    Strender, Lars-Erik
    Nilsson, Gunnar
    INFORMATICS FOR HEALTH & SOCIAL CARE, 2008, 33 (01): : 39 - 54
  • [47] INTEGRATION OF GIS-BASED SUITABILITY ANALYSIS AND MULTICRITERIA EVALUATION IN A SPATIAL DECISION-SUPPORT SYSTEM FOR ROUTE SELECTION
    JANKOWSKI, P
    RICHARD, L
    ENVIRONMENT AND PLANNING B-PLANNING & DESIGN, 1994, 21 (03): : 323 - 340
  • [48] Decision-Support System-based Service Delivery in the Product-Service System Context: Literature Review and Gap Analysis
    Sala, Roberto
    Pezzotta, Giuditta
    Pirola, Fabiana
    Huang, George Q.
    11TH CIRP CONFERENCE ON INDUSTRIAL PRODUCT-SERVICE SYSTEMS, 2019, 83 : 126 - 131
  • [49] STRATEGIES OF FAILURE DIAGNOSIS IN COMPUTER-CONTROLLED MANUFACTURING SYSTEMS - EMPIRICAL-ANALYSIS AND IMPLICATIONS FOR THE DESIGN OF ADAPTIVE DECISION-SUPPORT SYSTEMS
    KONRADT, U
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER STUDIES, 1995, 43 (04) : 503 - 521
  • [50] A decision-support system for recycling of residents' waste plastics in China based on material flow analysis and life cycle assessment
    Liu, Manzhi
    Wen, Jixin
    Zhang, Linlin
    Wu, Jixin
    Yang, Xiaotao
    Qin, Ying
    Liu, Yingjie
    ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH, 2023, 30 (11) : 29610 - 29634