Simplifying Neural Networks Using Formal Verification

被引:18
|
作者
Gokulanathan, Sumathi [1 ]
Feldsher, Alexander [1 ]
Malca, Adi [1 ]
Barrett, Clark [2 ]
Katz, Guy [1 ]
机构
[1] Hebrew Univ Jerusalem, Jerusalem, Israel
[2] Stanford Univ, Stanford, CA USA
来源
基金
以色列科学基金会; 美国国家科学基金会;
关键词
Deep neural networks; Simplification; Verification; Marabou;
D O I
10.1007/978-3-030-55754-6_5
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep neural network (DNN) verification is an emerging field, with diverse verification engines quickly becoming available. Demonstrating the effectiveness of these engines on real-world DNNs is an important step towards their wider adoption. We present a tool that can leverage existing verification engines in performing a novel application: neural network simplification, through the reduction of the size of a DNN without harming its accuracy. We report on the work-flow of the simplification process, and demonstrate its potential significance and applicability on a family of real-world DNNs for aircraft collision avoidance, whose sizes we were able to reduce by as much as 10%.
引用
收藏
页码:85 / 93
页数:9
相关论文
共 50 条
  • [1] NNTBFV: Simplifying and Verifying Neural Networks Using Testing-Based Formal Verification
    Liu, Haiyi
    Liu, Shaoying
    Xu, Guangquan
    Liu, Ai
    Fang, Dingbang
    [J]. INTERNATIONAL JOURNAL OF SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING, 2024, 34 (02) : 273 - 300
  • [2] Simplifying circuits for formal verification using parametric representation
    Moon, IH
    Kwak, HH
    Kukula, J
    Shiple, T
    Pixley, C
    [J]. FORMAL METHODS IN COMPUTER-AIDED DESIGN, PROCEEDINGS, 2002, 2517 : 52 - 69
  • [3] Formal verification for quantized neural networks
    Kovasznai, Gergely
    Kiss, Dorina Hedvig
    Mlinko, Peter
    [J]. ANNALES MATHEMATICAE ET INFORMATICAE, 2023, 57 : 36 - 48
  • [4] Formal verification for quantized neural networks
    Kovasznai, Gergely
    Kiss, Dorina Hedvig
    Mlinko, Peter
    [J]. ANNALES MATHEMATICAE ET INFORMATICAE, 2023, 57 : 36 - 48
  • [5] Formal Verification of Deep Neural Networks
    Narodytska, Nina
    [J]. PROCEEDINGS OF THE 2018 18TH CONFERENCE ON FORMAL METHODS IN COMPUTER AIDED DESIGN (FMCAD), 2018, : 1 - 1
  • [6] Formal Verification of Deep Neural Networks in Hardware
    Saji, Sincy Ann
    Agrawal, Shreyansh
    Sood, Surinder
    [J]. 2022 IEEE WOMEN IN TECHNOLOGY CONFERENCE (WINTECHCON): SMARTER TECHNOLOGIES FOR A SUSTAINABLE AND HYPER-CONNECTED WORLD, 2022,
  • [7] Verifying and Improving Neural Networks Using Testing-Based Formal Verification
    Liu, Haiyi
    Liu, Shaoying
    Liu, Ai
    Fang, Dingbang
    Xu, Guangquan
    [J]. STRUCTURED OBJECT-ORIENTED FORMAL LANGUAGE AND METHOD, SOFL+MSVL 2022, 2023, 13854 : 126 - 141
  • [8] Neural Networks Verification: Perspectives from Formal Method
    Maity, Priyanka
    [J]. PROCEEDINGS OF THE 17TH INNOVATIONS IN SOFTWARE ENGINEERING CONFERENCE, ISEC 2024, 2024,
  • [9] Rule extraction as a formal method for the verification and validation of neural networks
    Taylor, BJ
    Darrah, MA
    [J]. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Vols 1-5, 2005, : 2915 - 2920
  • [10] Neural networks in closed-loop systems: Verification using interval arithmetic and formal prover
    Rossi, Federico
    Bernardeschi, Cinzia
    Cococcioni, Marco
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 137