Simplifying Neural Networks Using Formal Verification

被引:18
|
作者
Gokulanathan, Sumathi [1 ]
Feldsher, Alexander [1 ]
Malca, Adi [1 ]
Barrett, Clark [2 ]
Katz, Guy [1 ]
机构
[1] Hebrew Univ Jerusalem, Jerusalem, Israel
[2] Stanford Univ, Stanford, CA USA
来源
基金
以色列科学基金会; 美国国家科学基金会;
关键词
Deep neural networks; Simplification; Verification; Marabou;
D O I
10.1007/978-3-030-55754-6_5
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep neural network (DNN) verification is an emerging field, with diverse verification engines quickly becoming available. Demonstrating the effectiveness of these engines on real-world DNNs is an important step towards their wider adoption. We present a tool that can leverage existing verification engines in performing a novel application: neural network simplification, through the reduction of the size of a DNN without harming its accuracy. We report on the work-flow of the simplification process, and demonstrate its potential significance and applicability on a family of real-world DNNs for aircraft collision avoidance, whose sizes we were able to reduce by as much as 10%.
引用
收藏
页码:85 / 93
页数:9
相关论文
共 50 条
  • [41] Offline Handwritten Signature Verification Using Deep Neural Networks
    Lopes, Jose A. P.
    Baptista, Bernardo
    Lavado, Nuno
    Mendes, Mateus
    [J]. ENERGIES, 2022, 15 (20)
  • [42] Algorithm Selection for Software Verification Using Graph Neural Networks
    Leeson, Will
    Dwyer, Matthew B.
    [J]. ACM TRANSACTIONS ON SOFTWARE ENGINEERING AND METHODOLOGY, 2024, 33 (03)
  • [43] Signature verification using shape descriptors and multiple neural networks
    Dehghan, M
    Faez, K
    Fathi, M
    [J]. IEEE TENCON'97 - IEEE REGIONAL 10 ANNUAL CONFERENCE, PROCEEDINGS, VOLS 1 AND 2: SPEECH AND IMAGE TECHNOLOGIES FOR COMPUTING AND TELECOMMUNICATIONS, 1997, : 415 - 418
  • [44] Face verification using correlation filters and autoassocoative neural networks
    Sao, AK
    Yegnanarayana, B
    [J]. PROCEEDINGS OF INTERNATIONAL CONFERENCE ON INTELLIGENT SENSING AND INFORMATION PROCESSING, 2004, : 364 - 367
  • [45] Face Verification Using Convolutional Neural Networks with Siamese Architecture
    Bukovcikova, Zuzana
    Sopiak, Dominik
    Oravec, Milos
    Pavlovicova, Jarmila
    [J]. PROCEEDINGS OF 2017 INTERNATIONAL SYMPOSIUM ELMAR, 2017, : 205 - 208
  • [46] Automatic Online Signature Verification: A Prototype Using Neural Networks
    Ahmed, Syed Khaleel
    Ramasamy, Agileswari K.
    Khairuddin, Anis Salwa Mohd.
    Omar, Jamaludin
    [J]. TENCON 2009 - 2009 IEEE REGION 10 CONFERENCE, VOLS 1-4, 2009, : 1448 - 1451
  • [47] Speaker verification for security systems using artificial neural networks
    Vieira, K
    Wilamowski, B
    Kubichek, R
    [J]. IECON '97 - PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON INDUSTRIAL ELECTRONICS, CONTROL, AND INSTRUMENTATION, VOLS. 1-4, 1997, : 1102 - 1107
  • [48] Formal Verification of Neural Network Controlled Autonomous Systems
    Sun, Xiaowu
    Khedr, Haitham
    Shoukry, Yasser
    [J]. PROCEEDINGS OF THE 2019 22ND ACM INTERNATIONAL CONFERENCE ON HYBRID SYSTEMS: COMPUTATION AND CONTROL (HSCC '19), 2019, : 147 - 156
  • [49] Formal Specification for Deep Neural Networks
    Seshia, Sanjit A.
    Desai, Ankush
    Dreossi, Tommaso
    Fremont, Daniel J.
    Ghosh, Shromona
    Kim, Edward
    Shivakumar, Sumukh
    Vazquez-Chanlatte, Marcell
    Yue, Xiangyu
    [J]. AUTOMATED TECHNOLOGY FOR VERIFICATION AND ANALYSIS (ATVA 2018), 2018, 11138 : 20 - 34
  • [50] Formal Synthesis of Lyapunov Neural Networks
    Abate, Alessandro
    Ahmed, Daniele
    Giacobbe, Mirco
    Peruffo, Andrea
    [J]. IEEE CONTROL SYSTEMS LETTERS, 2021, 5 (03): : 773 - 778