A Parallel Optimization Method for Robustness Verification of Deep Neural Networks

被引:0
|
作者
Lin, Renhao [1 ]
Zhou, Qinglei [1 ]
Nan, Xiaofei [1 ]
Hu, Tianqing [1 ]
机构
[1] Zhengzhou Univ, Sch Comp & Artificial Intelligence, Zhengzhou 450001, Peoples R China
关键词
deep neural networks; robustness verification; parallel acceleration; partition mode; task scheduling; REFINEMENT;
D O I
10.3390/math12121884
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Deep neural networks (DNNs) have gained considerable attention for their expressive capabilities, but unfortunately they have serious robustness risks. Formal verification is an important technique to ensure network reliability. However, current verification techniques are unsatisfactory in time performance, which hinders the practical applications. To address this issue, we propose an efficient optimization method based on parallel acceleration with more computing resources. The method involves the speedup configuration of a partition-based verification aligned with the structures and robustness formal specifications of DNNs. A parallel verification framework is designed specifically for neural network verification systems, which integrates various auxiliary modules and accommodates diverse verification modes. The efficient parallel scheduling of verification queries within the framework enhances resource utilization and enables the system to process a substantial volume of verification tasks. We conduct extensive experiments on multiple commonly used verification benchmarks to demonstrate the rationality and effectiveness of the proposed method. The results show that higher efficiency is achieved after parallel optimization integration.
引用
收藏
页数:19
相关论文
共 50 条
  • [1] Robustness Verification Boosting for Deep Neural Networks
    Feng, Chendong
    [J]. 2019 6TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE 2019), 2019, : 531 - 535
  • [2] PRODEEP: A Platform for Robustness Verification of Deep Neural Networks
    Li, Renjue
    Li, Jianlin
    Huang, Cheng-Chao
    Yang, Pengfei
    Huang, Xiaowei
    Zhang, Lijun
    Xue, Bai
    Hermanns, Holger
    [J]. PROCEEDINGS OF THE 28TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING (ESEC/FSE '20), 2020, : 1630 - 1634
  • [3] Eager Falsification for Accelerating Robustness Verification of Deep Neural Networks
    Guo, Xingwu
    Wan, Wenjie
    Zhang, Zhaodi
    Zhang, Min
    Song, Fu
    Wen, Xuejun
    [J]. 2021 IEEE 32ND INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING (ISSRE 2021), 2021, : 345 - 356
  • [4] Robustness Verification in Neural Networks
    Wurm, Adrian
    [J]. INTEGRATION OF CONSTRAINT PROGRAMMING, ARTIFICIAL INTELLIGENCE, AND OPERATIONS RESEARCH, PT II, CPAIOR 2024, 2024, 14743 : 263 - 278
  • [5] Efficient Robustness Verification of the Deep Neural Networks for Smart IoT Devices
    Zhang, Zhaodi
    Liu, Jing
    Zhang, Min
    Sun, Haiying
    [J]. COMPUTER JOURNAL, 2022, 65 (11): : 2894 - 2908
  • [6] Enhancing Robustness Verification for Deep Neural Networks via Symbolic Propagation
    Yang, Pengfei
    Li, Jianlin
    Liu, Jiangchao
    Huang, Cheng-Chao
    Li, Renjue
    Chen, Liqian
    Huang, Xiaowei
    Zhang, Lijun
    [J]. FORMAL ASPECTS OF COMPUTING, 2021, 33 (03) : 407 - 435
  • [7] Robustness Verification of Classification Deep Neural Networks via Linear Programming
    Lin, Wang
    Yang, Zhengfeng
    Chen, Xin
    Zhao, Qingye
    Li, Xiangkun
    Liu, Zhiming
    He, Jifeng
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 11410 - 11419
  • [8] Verification of Neural Networks' Global Robustness
    Kabaha, Anan
    Cohen, Dana Drachsler
    [J]. PROCEEDINGS OF THE ACM ON PROGRAMMING LANGUAGES-PACMPL, 2024, 8 (OOPSLA):
  • [9] An efficient test method for noise robustness of deep neural networks
    Yasuda, Muneki
    Sakata, Hironori
    Cho, Seung-Il
    Harada, Tomochika
    Tanaka, Atushi
    Yokoyama, Michio
    [J]. IEICE NONLINEAR THEORY AND ITS APPLICATIONS, 2019, 10 (02): : 221 - 235
  • [10] Survey on Robustness Verification of Feedforward Neural Networks and Recurrent Neural Networks
    Liu, Ying
    Yang, Peng-Fei
    Zhang, Li-Jun
    Wu, Zhi-Lin
    Feng, Yuan
    [J]. Ruan Jian Xue Bao/Journal of Software, 2023, 34 (07): : 1 - 33