Distributed Repair of Deep Neural Networks

被引:4
|
作者
Calsi, Davide Li [1 ]
Duran, Matias [2 ]
Zhang, Xiao-Yi [3 ]
Arcaini, Paolo [2 ]
Ishikawa, Fuyuki [2 ]
机构
[1] Polytech Univ Milan, Milan, Italy
[2] Natl Inst Informat, Tokyo, Japan
[3] Univ Sci & Technol Beijing, Beijing, Peoples R China
关键词
DNNs; automated repair; risk levels;
D O I
10.1109/ICST57152.2023.00017
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Deep Neural Networks (DNNs) are applied in several safety-critical domains and their trustworthiness is of paramount importance. For example, DNNs used in autonomous driving as classifiers should not misclassify detected objects; however, since obtaining perfect accuracy is not possible, special attention should be given to the most critical cases, e.g., pedestrians. This has been confirmed by the consortium of our partners from the automotive domain that provided us with specific risk levels for different misclassifications. A recent approach to improve DNN performance is to localise DNN weights responsible for the misclassifications and then adjust (repair) them to improve the misclassifications. However, they under-perform when they need to consider multiple misclassifications, and they do not consider the risk levels of the different misclassifications. To tackle this, we propose DISTRREP, a distributed repair approach that first finds the best fixes for each critical misclassification, and then integrates them in a single repaired DNN model, by considering the risk levels. We assess DISTRREP over three DNN models and a dataset of autonomous driving images, by considering requirements specified by our industrial partners. Experiments show that DISTRREP is more effective than baseline approaches based on retraining, and other risk-unaware repair approaches.
引用
收藏
页码:83 / 94
页数:12
相关论文
共 50 条
  • [1] Provable Repair of Deep Neural Networks
    Sotoudeh, Matthew
    Thakur, Aditya, V
    [J]. PROCEEDINGS OF THE 42ND ACM SIGPLAN INTERNATIONAL CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION (PLDI '21), 2021, : 588 - 603
  • [2] Federated Repair of Deep Neural Networks
    Li Calsi, Davide
    Laurent, Thomas
    Arcaini, Paolo
    Ishikawa, Fuyuki
    [J]. PROCEEDINGS OF THE 2024 IEEE/ACM INTERNATIONAL WORKSHOP ON DEEP LEARNING FOR TESTING AND TESTING FOR DEEP LEARNING, DEEPTEST 2024, 2024, : 17 - 24
  • [3] Deep distributed convolutional neural networks: Universality
    Zhou, Ding-Xuan
    [J]. ANALYSIS AND APPLICATIONS, 2018, 16 (06) : 895 - 919
  • [4] Distributed Newton Methods for Deep Neural Networks
    Wang, Chien-Chih
    Tan, Kent Loong
    Chen, Chun-Ting
    Lin, Yu-Hsiang
    Keerthi, S. Sathiya
    Mahajan, Dhruv
    Sundararajan, S.
    Lin, Chih-Jen
    [J]. NEURAL COMPUTATION, 2018, 30 (06) : 1673 - 1724
  • [5] Accelerating Training for Distributed Deep Neural Networks in MapReduce
    Xu, Jie
    Wang, Jingyu
    Qi, Qi
    Sun, Haifeng
    Liao, Jianxin
    [J]. WEB SERVICES - ICWS 2018, 2018, 10966 : 181 - 195
  • [6] Distributed Deep Neural Networks with System Cost Minimization in Fog Networks
    Shah, Syed Danial Ali
    Zhao, Hong Ping
    Kim, Hoon
    [J]. PROCEEDINGS OF TENCON 2018 - 2018 IEEE REGION 10 CONFERENCE, 2018, : 1193 - 1196
  • [7] An In-Depth Analysis of Distributed Training of Deep Neural Networks
    Ko, Yunyong
    Choi, Kibong
    Seo, Jiwon
    Kim, Sang-Wook
    [J]. 2021 IEEE 35TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS), 2021, : 994 - 1003
  • [8] Distributed Deep Convolutional Neural Networks for the Internet-of-Things
    Disabato, Simone
    Roveri, Manuel
    Alippi, Cesare
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2021, 70 (08) : 1239 - 1252
  • [9] Distributed training of deep neural networks with spark: The MareNostrum experience
    Cruz, Leonel
    Tous, Ruben
    Otero, Beatriz
    [J]. PATTERN RECOGNITION LETTERS, 2019, 125 : 174 - 178
  • [10] Parallel and Distributed Training of Deep Neural Networks: A brief overview
    Farkas, Attila
    Kertesz, Gabor
    Lovas, Robert
    [J]. 2020 IEEE 24TH INTERNATIONAL CONFERENCE ON INTELLIGENT ENGINEERING SYSTEMS (INES 2020), 2020, : 165 - 170