MOFP: Multi-Objective Filter Pruning for Deep Learning Models

被引:0
|
作者
Yang, Jen-Chieh [1 ]
Lin, Hung-I [1 ]
Kuo, Lin-Jing [1 ]
Wang, Sheng-De [1 ]
机构
[1] Natl Taiwan Univ, Dept Elect Engn, Taipei, Taiwan
关键词
Non-Dominated Sorting Genetic Algorithms II; Pareto Fronts; Non-Dominated Sorting; Crowding Distance; Asymmetric Gaussian Distribution; Filter Pruning; ALGORITHM;
D O I
10.1109/TrustCom60117.2023.00340
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper proposes a new approach called Multi-Objective Filter Pruning (MOFP), which formulates the filter pruning of deep learning models as a multi-objective optimization problem. The proposed approach applies the Non-Dominated Sorting Genetic Algorithm II to solve the problem and the Asymmetric Gaussian Distribution (AGD) for population initialization. Compared with existing methods, MOFP shows competitiveness in terms of a balance of objectives between compression rates, computing power, and prediction accuracy. In addition, the search result of MOFP is a Pareto Front, which eliminates the need for multiple searches to obtain architectures with different compression rates, significantly improving overall search efficiency. The results show that the use of AGD for population initialization can enhance the search process by effectively exploring the search space, leading to higher quality results.
引用
收藏
页码:2414 / 2423
页数:10
相关论文
共 50 条
  • [1] Multi-objective pruning of dense neural networks using deep reinforcement learning
    Hirsch, Lior
    Katz, Gilad
    INFORMATION SCIENCES, 2022, 610 : 381 - 400
  • [2] A Taxonomy and Review of the Multi-Objective Fractional Programming (MOFP) Problems
    Bhati D.
    Singh P.
    Arya R.
    International Journal of Applied and Computational Mathematics, 2017, 3 (3) : 2695 - 2717
  • [3] MOSP: Multi-Objective Sensitivity Pruning of Deep Neural Networks
    Sabih, Muhammad
    Mishra, Ashutosh
    Hannig, Frank
    Teich, Jürgen
    2022 IEEE 13TH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING CONFERENCE (IGSC), 2022, : 59 - 66
  • [4] Multi-objective recognition based on deep learning
    Liu, Xin
    Wu, Junhui
    Man, Yiyun
    Xu, Xibao
    Guo, Jifeng
    AIRCRAFT ENGINEERING AND AEROSPACE TECHNOLOGY, 2020, 92 (08): : 1185 - 1193
  • [5] A multi-objective deep reinforcement learning framework
    Thanh Thi Nguyen
    Ngoc Duy Nguyen
    Vamplew, Peter
    Nahavandi, Saeid
    Dazeley, Richard
    Lim, Chee Peng
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2020, 96
  • [6] Pruning Algorithm for Multi-objective Optimization
    Sudeng, Sufian
    Wattanapongsakorn, Naruemon
    2013 10TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (JCSSE), 2013, : 70 - 75
  • [7] Pruning the Way to Reliable Policies: A Multi-Objective Deep Q-Learning Approach to Critical Care
    Shirali, Ali
    Schubert, Alexander
    Alaa, Ahmed
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (10) : 6268 - 6279
  • [8] GenExp: Multi-objective pruning for deep neural network based on genetic algorithm
    Xu, Ke
    Zhang, Dezheng
    An, Jianjing
    Liu, Li
    Liu, Lingzhi
    Wang, Dong
    NEUROCOMPUTING, 2021, 451 : 81 - 94
  • [9] Urban Driving with Multi-Objective Deep Reinforcement Learning
    Li, Changjian
    Czarnecki, Krzysztof
    AAMAS '19: PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS, 2019, : 359 - 367
  • [10] Multi-Objective Deep Learning with Adaptive Reference Vectors
    Chen, Weiyu
    Kwok, James T.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,