Federated Repair of Deep Neural Networks

被引:0
|
作者
Li Calsi, Davide [1 ]
Laurent, Thomas [2 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Natl Inst Informat, Tokyo, Japan
关键词
Deep Neural Networks; DNN repair; federation;
D O I
10.1145/3643786.3648025
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As DNNs are embedded in more and more critical systems, it is essential to ensure that they perform well on specific inputs. DNN repair has shown good results in fixing specific misclassifications in already trained models using additional data, even surpassing additional training. In safety-critical applications, such as autonomous driving, collaboration between industrial actors would lead to more representative datasets for repair, that would enable to obtain more robust models and thus safer systems. However, these companies are reluctant to share their data, to both protect their intellectual property and the privacy of their users. Federated Learning is an approach that allows for collaborative, privacy-preserving training of DNNs. Inspired by this technique, this work proposes Federated Repair in order to collaboratively repair a DNN model without the need for sharing any raw data. We implemented Federated Repair based on a state-of-the-art DNN repair technique, and applied it to three DNN models, with federation size from 2 to 10. Results show that Federated Repair can achieve the same repair efficiency as non-federated DNN repair using the pooled data, despite the presence of rounding errors when aggregating clients' results.
引用
收藏
页码:17 / 24
页数:8
相关论文
共 50 条
  • [1] Distributed Repair of Deep Neural Networks
    Calsi, Davide Li
    Duran, Matias
    Zhang, Xiao-Yi
    Arcaini, Paolo
    Ishikawa, Fuyuki
    [J]. 2023 IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION, ICST, 2023, : 83 - 94
  • [2] Provable Repair of Deep Neural Networks
    Sotoudeh, Matthew
    Thakur, Aditya, V
    [J]. PROCEEDINGS OF THE 42ND ACM SIGPLAN INTERNATIONAL CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION (PLDI '21), 2021, : 588 - 603
  • [3] Federated Learning for Medical Image Analysis with Deep Neural Networks
    Nazir, Sajid
    Kaleem, Mohammad
    [J]. DIAGNOSTICS, 2023, 13 (09)
  • [4] Optimized Quantization for Convolutional Deep Neural Networks in Federated Learning
    Kim, You Jun
    Hong, Choong Seon
    [J]. APNOMS 2020: 2020 21ST ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2020, : 150 - 154
  • [5] A Survey on Attacks and Their Countermeasures in Deep Learning: Applications in Deep Neural Networks, Federated, Transfer, and Deep Reinforcement Learning
    Ali, Haider
    Chen, Dian
    Harrington, Matthew
    Salazar, Nathaniel
    Al Ameedi, Mohannad
    Khan, Ahmad Faraz
    Butt, Ali R.
    Cho, Jin-Hee
    [J]. IEEE ACCESS, 2023, 11 : 120095 - 120130
  • [6] Architecture-Preserving Provable Repair of Deep Neural Networks
    Tao, Zhe
    Nawas, Stephanie
    Mitchell, Jacqueline
    Thakur, Aditya V.
    [J]. PROCEEDINGS OF THE ACM ON PROGRAMMING LANGUAGES-PACMPL, 2023, 7 (PLDI):
  • [7] Adaptive Search-based Repair of Deep Neural Networks
    Calsi, Davide Li
    Duran, Matias
    Laurent, Thomas
    Zhang, Xiao-Yi
    Arcaini, Paolo
    Ishikawa, Fuyuki
    [J]. PROCEEDINGS OF THE 2023 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, GECCO 2023, 2023, : 1527 - 1536
  • [8] Arachne: Search-Based Repair of Deep Neural Networks
    Sohn, Jeongju
    Kang, Sungmin
    Yoo, Shin
    [J]. ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2023, 32 (04)
  • [9] Federated Reservoir Computing Neural Networks
    Bacciu, Davide
    Di Sarli, Daniele
    Faraji, Pouria
    Gallicchio, Claudio
    Micheli, Alessio
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [10] Federated Boolean Neural Networks Learning
    Leconte, Louis
    Van Minh Nguyen
    Moulines, Eric
    [J]. 2023 EIGHTH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING, FMEC, 2023, : 247 - 253