Simplifying Neural Networks Using Formal Verification

被引:18
|
作者
Gokulanathan, Sumathi [1 ]
Feldsher, Alexander [1 ]
Malca, Adi [1 ]
Barrett, Clark [2 ]
Katz, Guy [1 ]
机构
[1] Hebrew Univ Jerusalem, Jerusalem, Israel
[2] Stanford Univ, Stanford, CA USA
来源
基金
以色列科学基金会; 美国国家科学基金会;
关键词
Deep neural networks; Simplification; Verification; Marabou;
D O I
10.1007/978-3-030-55754-6_5
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep neural network (DNN) verification is an emerging field, with diverse verification engines quickly becoming available. Demonstrating the effectiveness of these engines on real-world DNNs is an important step towards their wider adoption. We present a tool that can leverage existing verification engines in performing a novel application: neural network simplification, through the reduction of the size of a DNN without harming its accuracy. We report on the work-flow of the simplification process, and demonstrate its potential significance and applicability on a family of real-world DNNs for aircraft collision avoidance, whose sizes we were able to reduce by as much as 10%.
引用
收藏
页码:85 / 93
页数:9
相关论文
共 50 条
  • [31] Building and simplifying artificial neural networks with genetic programming
    Rivero, Daniel
    Dorado, Julian
    Rabuñal, Juan
    Pazos, Alejandro
    [J]. WSEAS Transactions on Information Science and Applications, 2007, 4 (03): : 500 - 507
  • [32] Simplifying approach to node classification in Graph Neural Networks
    Maurya, Sunil Kumar
    Liu, Xin
    Murata, Tsuyoshi
    [J]. JOURNAL OF COMPUTATIONAL SCIENCE, 2022, 62
  • [33] SIMPLIFYING NEURAL NETWORKS BY SOFT WEIGHT-SHARING
    NOWLAN, SJ
    HINTON, GE
    [J]. NEURAL COMPUTATION, 1992, 4 (04) : 473 - 493
  • [34] Verification and Repair of Neural Networks
    Guidotti, Dario
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 15714 - 15715
  • [35] Incremental Verification of Neural Networks
    Ugare, Shubham
    Banerjee, Debangshu
    Misailovic, Sasa
    Singh, Gagandeep
    [J]. PROCEEDINGS OF THE ACM ON PROGRAMMING LANGUAGES-PACMPL, 2023, 7 (PLDI): : 1920 - 1945
  • [36] Neural Networks for Runtime Verification
    Perotti, Alan
    Garcez, Artur d'Avila
    Boella, Guido
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 2637 - 2644
  • [37] Static Digital Signature Recognition and Verification using Neural Networks
    Chauhan, Prachi
    Chandra, Subhash
    Maheshkar, Sushila
    [J]. 2016 1ST INDIA INTERNATIONAL CONFERENCE ON INFORMATION PROCESSING (IICIP), 2016,
  • [38] Robustness Verification in Neural Networks
    Wurm, Adrian
    [J]. INTEGRATION OF CONSTRAINT PROGRAMMING, ARTIFICIAL INTELLIGENCE, AND OPERATIONS RESEARCH, PT II, CPAIOR 2024, 2024, 14743 : 263 - 278
  • [39] Off-line Signature Verification Using Neural Networks
    Lakshmi, K. V.
    Nayak, Seema
    [J]. PROCEEDINGS OF THE 2013 3RD IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC), 2013, : 1065 - 1069
  • [40] THE POTENTIAL IN USING BACKPROPAGATION NEURAL NETWORKS FOR FACIAL VERIFICATION SYSTEMS
    SOLHEIM, I
    PAYNE, TL
    CASTAIN, R
    [J]. SIMULATION, 1992, 58 (05) : 306 - 310